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Preface 


In the beginning was the image... The main title of the sixth volume in the Series 
Visual Learning (VL) was borrowed from William Horton’ The Icon Book (and also 
appears in Shlain’s book). The slightly altered Bible verse was cited in the workshop 
presentation Forgotten Theories of the Image delivered in June 2016 by Kristóf Nyíri, 
co-founder, with András Benedek, of the workshop and the series. In this presenta- 
tion Nyíri argued that "there are not many famous authors whose works are, so to 
say, must-reads for their contemporaries, and there are not many sub-disciplines 
whose professionals naturally - for their own good and as an obligation - make 
reference to each other. VLL members do not constitute such a sub-discipline; but 
they might as well put their efforts in a somehow convergent theoretical direction? 
This aim is pursued by the events of the Visual Learning Lab (VLL), organised by 
the Budapest University of Technology and Economics for seven years now since 
2009: the monthly seminar-like workshops and the annual international confer- 
ence. À peer reviewed selection of such conference papers is published every year 
in the Series Visual Learning by the Peter Lang publishing house. 

In honour of the traditions, the main title of the November 2015 conference 
was again a triple alliteration: Time, Truth, Tradition. The editors of the current 
volume selected 16 of the 30 papers presented in the conference. The papers can be 
divided into four major thematic groups: the theoretical questions of visuality; visual 
rhetoric; online visuality; and visuality in teaching and learning. Using a fashionable 
way to visualise keywords, the full content of the book can be compressed into the 
following word cloud (W1) which reveals the main points of contact: 
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The keynote paper of the book is authored by Kristóf Nyíri, and titled: Towards 
a Theory of Common-Sense Realism. In his paper he aimed to “outline a specific 
philosophical strategy for the defence of common-sense realism and the rejection 
of relativism. The strategy is specific in that itis based on the assumption that the 
human mind is a visual one - indeed [...] fundamentally a kinesthetic or motor 
one. The primary contact we make with reality is not verbally mediated; rather, it 
is direct, kinesthetic, perceptual, visual”. The paper distinguishes common sense, 
common-sense realism and scientific realism from relativism and from each other 
as well. Referring to, among others, Gombrich, Arnheim and Gibson, the author 
makes a case for (common-sense) realism in connection with visuality. In this 
regard, Nyíri concludes that “contemporary common sense does not have room, 
justas common sense never had room, for relativism. Common sense believes that 
it relies on the best available sources of knowledge. It understands that it might 
hold erroneous views, but trusts that progress will correct them. 

The same aspect, Truth, is reflected in Sybille Krámer's paper Truth in Testi- 
mony: Or can a Documentary Film ‘Bear Witness’? Some Reflections on the Differ- 
ence between Discursive and Existential Truth. An Austrian with Bosnian roots, 
director Haris Bilajbegovic filmed a documentary about the cruelties committed 
by Serbian militiamen in a Bosnian village in 1992. The mass execution had only 
one survivor whose testimony provided the grounds for the Hague Tribunal to 
convict the perpetrators years later. The 2012 film, which also cites statements 
from the testimony, was presented as a documentary. This provides the setting 
for the author to examine the dilemma of eye-witnessing, making reference to, 
among others, Derrida and Seren Kierkegaard’s concept of “Existential Truth": 
"The dilemma associated with eye-witnessing can be expressed this way: speaking 
the truth constitutes the foundation and function of witnessing, yet at the same 
time nothing is as fallible and prone to error as witness testimony? Going back 
to the film Svjedok - The Witness, he establishes that it "can be understood as not 
only a documentary film but also a form of ‘testimony’ because the medium of 
film instantiates a social relation between the survivor witness and the filmmaker" 

Referring back to the Krámer text in the fourth volume of the VL series and 
her own paper, Valeria Giardino presents her “hypothesis about the existence of a 
human capacity labelled diagramming”, and connects it to a philosophy of mind. 
Thanks to the capacity of diagramming, “humans are able to recruit a variety 
of cognitive systems - spatial perception and action systems - that are already 
available in other contexts, with the specific aim of reducing cognitive loads for 
memory and assisting problem solving" The diagramming hypothesis can be 
linked to the moderate approach to embodiment. The author's hypothesis is based 
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on evidence brought from experimental psychology and philosophy of mathemat- 
ics: gestures in mathematical explanation (as "gestures show that spatial and motor 
elements might help comprehension"), formulas in algebra and diagrams in topol- 
ogy. Giardino says that "spatial cognitive artefacts act as multi-recruiting systems". 

Daniel L. Golden focused on the visual management of time, and examined 
what tools of visuality (sundials, clockworks, time lines, calendars and time tables) 
help to put the flow of time under control. Such tools are“built upon visual com- 
ponents in order to make the abstraction conceivable, communicable, and opera- 
ble for the human mind”, he says. The “main driving force behind the requirements 
on timing, tracking, and synchronizing human activities" was the set of events 
called taylorism, which is connected to industrialization and free competition, 
and resulted in the increasingly fashionable concepts of time management and 
time economy. Golden presents the most important concepts of time (including 
the dichotomies organic vs. mechanical time; public time vs. private time, linear 
vs. cyclical time), as well as the traditional and novel tools of visualisation. 

In the following chapter, Javier E. Carrefio examines, on the basis of the phe- 
nomenologist Edmund Husserl, how static images can “apparently ‘without a time; 
strike us as having a right timing" This issue is raised in the phenomenological 
analyses of image-consciousness, time-consciousness, and aesthetic conscious- 
ness. He says: “the awareness of the ‘right timing of an image is a temporal aware- 
ness that an image triggers by intensifying the awareness of the depicted subject in 
a particular time-phase”, and “in the case of a perfect timing of images; the viewer 
will be drawn towards the image now’ phase in its completeness to a degree that 
can even disengage further phantasy continuations”. 

Petra Aczél - for the sixth time in the Series Visual Learning - argues for the 
need to rediscover the visual in the rhetorical tradition. As a recent development 
in scientific discourse, the importance of visuality is now accepted in the fields 
of human cognition and communication, and "the prevalence of images has ap- 
parently won over the scepticism of science towards the non-verbal" By contrast, 
in rhetoric, which is considered as a mainly verbal field, the role of visuality has 
still not been rediscovered (except for the topic of “visual tropes”). Following a 
consistent logic, this time the paper focuses on the "persuasion as visionary in sua- 
sory discourse with particular respect to “the function of wonder (thaumazein), 
the connection between the verbal and visual and between the visionary and 
the persuasive-charismatic" In this regard, the connection between rhetoric and 
visuality can be concluded this way: “rhetoric and the rhetorical style is persuasive 
because of its visionary - making audiences to see, to feel, to enact - potential that 
is rooted in the speaker's visual-sensual encounter with the world? 
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Timothy Barney’s paper adopts a rhetorical approach as well in examining 
the rhetorical lives of (Cold War) maps. The rhetorical life of a map, in his views, 
means that^a map has a particular lifespan in which it exists as a communica- 
tive practice, as it works through the intersections of public and private spaces, 
institutional and popular contexts, and artistic and scientific modes of collection, 
synthesis, and expression" According to this concept, maps are linked both to the 
immediate document-level context and to the historic context. Using the concepts 
of Denis Wood and John Fels, Barney calls this context (which involves dedica- 
tions, inscriptions, epigraphs, prefaces, notes, illustrations, and advertisements for 
the map, reviews, production information) paramap. This way, "a map is never 
just a map, but a confluence of social forces that constrains a culture' sense of its 
relationship to, and in, the world". To support his theory, the author analyses an 
American map taken about the Gulag in the Cold War era. 

In her paper Paintings and Illuminated Manuscripts as Sources of the History of 
Childhood: Conceptions of Childhood in the Renaissance, Orsolya Endródy-Nagy 
gives insight into a larger qualitative research project. Her goal is to "describe how 
the conceptions of childhood changed in a specific period during the 15th and 
16th centuries, with the help of Renaissance paintings and other visual docu- 
ments (manuscripts, old-prints and wooden-block prints), using qualitative analy- 
sis methods of semiotics, iconography, visual anthropology and visual sociology. 

With a big leap in time (but without departing from the topic of visuality) we 
arrive to our present days and our focus is shifted toward the online world. All the 
papers in this bigger unit are connected to digital communication: online reading 
and online media; selfie as a special type of image shared over the internet; and 
hashtags, that is the labels attached to images. 

Krisztina Szabó analyses digital and visual literacy from the perspective of the 
role of visuality in contemporary online reading, and states that "visual elements 
are neither just illustrations, nor just explanatory additional elements, nor second- 
ary qualities beside texts, but they have at least an equal or even dominating role 
over text in the online reading processes’, in fact, "in some cases [...] the text is 
subordinated to the visual”. Her aim with this examination is "to help create and 
develop online reading literacy surveys of PISA (Programme for International 
Student Assessment), by making the methodological framework more adequate" 

Gergely Havasmezói's paper is, in a way, a continuation of the previous one, as 
he presents the findings of an empirical research conducted on images published 
in the Hungarian online press. He distinguishes between two media groups based 
on whether they are published online or offline: “traditional” media which have 
a print version, their online versions thus being of secondary importance, and 
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“new” media, which exclusively have an online form. His hypothesis, that there are 
significantly more visual elements in the articles of the“new” media, gained confir- 
mation. The other thesis“that significantly more visual elements have self-standing 
contentual value in the new" media and the images appear in roles that does not 
exist in the ‘traditional’ media at all; got confirmed too, though less strongly. 

These papers are followed by another tightly connected pair of works, both 
dealing with the selfie phenomenon, and both making reference to Lev Manovich's 
Selfie-City project and Instagram studies. Trischa Goodnow’s analysis, which also 
relates to the rhetoric session of the book, focuses on the rhetorical implications 
of digital self portraiture for contemporary culture and states that "selfies reflect 
cultural perceptions about narrative, time, and values" She highlights three main 
values which make the selfie culture even more powerful and perceivable: adven- 
ture, popularity and attractiveness. Goodnow describes the relationship between 
selfie and time that “this type of image communicates the ‘presentist’ nature of 
contemporary culture" 

James E. Katz and Elizabeth Thomas Crocker interpret selfie as a form of in- 
terpersonal communication, and they "see selfies as often filling an important 
conversational role”. “As symbolic representations of self” selfies “are signs that 
evoke or provoke variegated meanings, and thereby are communicating ideas 
that competent viewers can discern” The authors examined the selfie phenom- 
enon on the basis of frequency of making self-portraits, sharing them publically 
or privately, staging/spontaneity dimensions and the motives of making selfies. 
They concluded that "the power of the facial image, containing as it does so much 
information and meaning, will doubtless remain an important feature of the way 
we interpret the world visually, emotionally, and psychologically. Truly, we live in 
a world of images.” 

Agnes Veszelszkis paper deals with a new, image-bound, minimalistic type of 
text, the so-called hashtag, which can be attached as metainformation to (even 
selfie-like) pictures on social networking websites and microblogging services. 
She examines the relationship between image and text (e.g. Instagram photo and 
hashtag) on the examples #time, #truth, tradition. Hashtag as metadata has the 
ability to append linguistic signs to an image, to facilitate its classification, archiv- 
ing, retrieval and indicate authorship. With their sorting and searching function 
hashtags "not only connect different content or thematic blocs, but also connect 
users having similar fields of interests" Hashtags are deictic, indexical and are also 
used to abbreviate messages and to add some kind of a stylistic touch to what is 
being said. In its broader sense, the hashtag may be taken as the marker of epis- 
temological modality in relation to the text. 
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The last large thematic unit is comprised by three papers expressly reflecting 
on the relationship between education and visuality. Matthew Crippen deals with 
the works of John Dewey who “understood aesthetic experience as a dramatic 
process". The author discusses "how visual experience is imbued with narrative 
and therefore temporal structure, and the importance of this to understanding 
and learning" *Dewey favoured concepts of experience articulated by Plato and 
Aristotle, albeit giving experience more value than his predecessors? These is- 
sues are discussed by Crippen in a modern knowledge approach, with particular 
focus on the classical tekhné vs. theoria distinction which suggested that tekhné 
is a "lesser form of knowledge than theoria, that is, theoretical or contemplative 
knowledge" Dewey thinks that science and knowledge can be taken as a form of 
art. And what are the pedagogical implications of all this? “[...] we change the 
world and produce outcomes that change us. Thereby we learn.” 

Almost as a continuation of this train of thought, András Benedek argues for 
the active involvement of students and the importance of visuality in learning, 
and presents the software SysBook. The online framework was developed by a 
research group of the Budapest University of Technology and Economics. “Higher 
education has always been a unique laboratory for education-related innovations, 
concentrating significant research and development potentials with excellent sub- 
jects for experiments aiming at modernising education, i.e. students? In the light 
of the findings of Benedek et al., the requirements of knowledge- and ICT-based 
society is best reflected by curricula in which *verbal and visual elements are 
presented in a one-to-one ratio, and where knowledge elements are organized 
into a network, would be scale-independent and structured as a graph”. The main 
criteria for such new type of (higher education) curricula can be expressed in six 
points: open online content; continuous synchronisation; automatic updating; 
content sharing and data security; unlimited memory (cloud services); a new 
creative learning environment. 

The micro-content - Micro-content Generation Framework as a Learning Inno- 
vation presented by János Horváth Cz. - also forms part of this system. In essence, 
micro-content means that information is well structured, the units have limited 
volume, “while the validity of the information contained therein is guaranteed by 
the involvement of named authors, feedback by the community and proofreading 
provided by teachers”. The author briefly overviews the history of micro-forms 
from postcards to text messages, Twitter and Snapchat messages, and also makes 
reference to SysBook. On the basis of what we know about the information collec- 
tion habits of current higher education students, it could prove an efficient means 
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of knowledge transfer to split content into smaller, more manageable chunks, and 
to let students create such information units for themselves. 

The tradition of the Visual Learning Lab continues: our international con- 
ference will be held in 2017 as well, this time focusing on the three concepts of 
virtual - visual - veridical. It is also part of the tradition that the editors have 
checked all online references in the book before publication, so the date of last 
availability is not indicated after the URLs (but a note is made where the content 
is no longer available). 

From 2016 Kristóf Nyíri will be replaced by Ágnes Veszelszki in the editorial of 
the series, but to maintain continuity, they will work together with Prof. András 
Benedek in the future. In order to ensure the solid theoretical foundations of the 
VLL workshops and the international conferences, Prof. Nyíri continues to take an 
active part in the implementation of these events. The editors are highly grateful 
and indebted to Kristóf Nyíri for his role in founding the research group, launch- 
ing and editing the series, and for his outstandingly accurate work. 
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TRUTH, TIME AND VISUALITY 


Kristóf Nyíri 


Towards a Theory of Common-Sense Realism 


0. The Visual Mind 


My aim in the present paper is to outline a specific philosophical strategy for the 
defense of common-sense realism and the rejection of relativism. The strategy 
is specific in that it is based on the assumption that the human mind is a visual 
one - indeed, as I will stress, fundamentally a kinesthetic or motor one. The pri- 
mary contact we make with reality is not verbally mediated; rather, it is direct, 
kinesthetic, perceptual, visual. 

Now my impression is that the visual approach is still entirely foreign to main- 
stream philosophy. So let me here begin, so to speak, at an introductory level. Let 
me perform, in your virtual presence, an experiment. The task is to count the 
number of ground-floor level windows in the house I live in. Normally, I could 
just walk around the house, and count the windows. But if I happen to be away, 
giving a conference talk, I cannot do that. What I can do is to close my eyes, im- 
agine going round the house, and mentally count the windows. Having concluded 
the experiment, I come up with the number 10. Perhaps I have made a mistake. 
If I have, I can, once at home, correct myself by actually walking around and 
counting. Others are welcome to come to my place and repeat the counting. The 
result will, perhaps after some initial misunderstandings and explanations, turn 
out to be the same in every case, and in any conceptual framework. There will be 
nothing relative about it. 

Would you be able to perform a similar experiment? Does everyone have vivid 
mental images? My understanding is that quite a few people claim not to experi- 
ence such. And of course this is, famously, what Galton learnt in the 1880s, when 
sending out a questionnaire asking what kind of visual memories the addressee 
had of his or her breakfast table of that morning. Did they remember the layout of 
the items on the table? Did they remember colours? It was, mostly, well-educated 
adult males, having spent a lifetime with reading and writing, who replied that 
they had no visual recollections whatsoever, no visual mental images. Galton 
was baffled, and tried to find a solution to the problem: how do then these people 
manage to think at all? His solution: 
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[...] the missing faculty seems to be replaced so serviceably by other modes of concep- 
tion, chiefly, I believe, connected with the incipient motor sense, not of the eyeballs only 
but of the muscles generally, that men who declare themselves entirely deficient in the 
power of seeing mental pictures can nevertheless give life-like descriptions of what they 
have seen and can otherwise express themselves as if they were gifted with a vivid visual 
imagination (Galton 1907 [1883]: 61). 


Not only in the case of memory images, but more generally, too, there is the mo- 
tor dimension beneath the visual one. Facial expressions and gestures precede 
words both in the evolution of mankind and the development of the individual. 
This is an ancient insight, formulated by Plato already, insisted on also by Thomas 
Reid, the emblematic figure of common-sense philosophy. Reid was impressed 
by what he saw as "the natural signs of human thoughts, purposes, and desires 
[...] the natural language of mankind. An infant,’ Reid wrote, “may be put into 
a fright by an angry countenance, and soothed again by smiles" (Reid 1769: 89). 
This became a great subject for Darwin, too. A topic he was particularly fasci- 
nated by was the expression of attitudes such as affirmation and negation. To 
quote just two brief passages: “[a] man [...] who vehemently rejects a proposi- 
tion, will almost certainly shut his eyes or turn away his face [...] in refusing 
food, especially if it be pressed on them, children frequently move their heads 
several times from side to side, as we do in shaking our heads in negation” 
(Darwin 1872: 32, 273). Some years later Mallery, in his Sign Language Among 
North American Indians, described the gesture of “negation [...] expressed by 
the right hand raised toward the shoulder, with the palm opposed to the person 
to whom response is made. This is the rejection of the idea presented” (Mallery 
1881: 290). And let me here add a one-sentence third quote, written a century 
later by the prominent scientific realist Wilfrid Sellars, in a late paper of his 
where he as it were stepped back from the linguistic bias so characteristic of his 
major works: “The concept of rejection is more basic than the concept of nega- 
tion” (Sellars 1981: 342). 

Gestures do more than just express attitudes. The art theorist and Gestalt psy- 
chologist Rudolf Arnheim in his Visual Thinking speaks of “descriptive” gestures, 


[...] those forerunners of line drawing. [...] the perceptual qualities of shape and motion 
are present in the very acts of thinking depicted by the gestures and are in fact the medium 
in which the thinking itself takes place. These perceptual qualities are not necessarily 
visual or only visual. In gestures, the kinesthetic experiences of pushing, pulling, advanc- 
ing, obstructing, are likely to play an important part (Arnheim 1969: 117 f.). 
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Arnheim’s views on visual imagery and the motor have been strongly influenced 
by the prominent turn-of-the-century American psychologist Titchener. Accord- 
ing to the latter, *[m]eaning is, originally, kinaesthesis; the organism faces the 
situation by some bodily attitude" (Titchener 1909: 176). Words build on imagery, 
but imagery, Titchener stressed, builds on kinaesthesis. Titchener’s position was 
taken up and radicalized by Margaret Washburn. As she put it: “the whole of the 
inner life is correlated with and dependent upon bodily movement" (Washburn 
1916: xiii). 

To round out and sum up: Verbal language emerges from the natural language 
of facial expressions and gestures, which are movement and image at the same 
time. Our core vocabulary gains meaning from the visual and motor images it 
is based on (our extended vocabulary consists of metaphors, but to understand 
a live metaphor! it is necessary to grasp the images it evokes). The human mind 
is primarily visual and motor. It is not through the mediation of words we make 
contact with reality, but through direct perception, with visual perception playing 
the definitive role. 


1. Realism vs. Relativism 


The sentence I concluded the previous section with amounts to a partial - 
rudimentary - description of, and argument for, my position: common-sense 
realism. Now realism - as also anti-realism, thus also relativism - seems to come 
in innumerable varieties. Let me here print an oft-visited diagram (cf. Figure 1) 
from the internet (W1), and let me make some comments. First, common-sense 
realism is mistakenly said to be“naive”; it is a sophisticated philosophical position; 
the views of the common man in the street do not yet amount to a philosophy 
of common sense. 

Secondly, I suggest that common-sense realism is the only realism worthy of 
the name, all other “realisms” are phoney compromises.’ Thirdly, I have to point 
out that non-relativists of course have a hard time understanding the fine distinc- 
tions relativists make between varieties of their creed; they find it difficult not to 


1 On image and metaphor see Nyíri 2014: 30, 89, 93 f., 99 f. 
I feel it particularly important to say this when it comes to today's so fashionable 
“structural realism,” see my argument in the chapter Visualization and the Horizons of 
Scientific Realism (in Nyíri 2014, see there esp. p. 33). In the diagram above, ESR stands 
for “epistemic structural realism,” OSR for “ontological structural realism" (and NOA 
for "natural ontological attitude"). 
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see relativism and social constructivism as belonging to the same continuum; and 
they believe any relativism, if it goes beyond the obvious, is false. 


Figure I: Diagram: Philosophy of Science 
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A relativism clearly going beyond the obvious is “epistemic replacement relativ- 
ism" In a recent defence of this approach, taking issue with Paul Boghossian, 
Martin Kusch wrote: 


[...] Galileo recognized that facts about motion are relative facts. [...] Galileo showed 
that [...] utterances of the form x moves are untrue - they are either false or incomplete. 
Moreover, Galileo also pointed out that the closest truths in the vicinity of these untruths 
are relational truths of the form x moves relative to frame of reference F. This makes it 
natural to suggest that Galileo was asking us to change the way we speak: replace the 
nonrelativized sentences with relativized ones, and assert only the relational proposi- 
tions. [...] Galileos relativism is the paradigm instance of the template of "replacement 
relativism" (Kusch 2010: 165). 
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In his analysis, Kusch suggests the formula: “our epistemic system [...] is one of 
many equally valid epistemic systems" (Kusch 2010: 170). And he makes it clear 
that this is a formula that actually expresses his own position. 

We have here a clear example of what one might call the linguistic bias in 
philosophy - note that people basically do not speak about movement, they see 
it and experience it. And when - rarely - they do experience relative movement, 
they asa rule, sooner or later, discover that they were suffering from an illusion. 
Enlightened common sense today understands that the Earth's immobility is 
such an illusion. But I wonder if one should convince enlightened common 
sense to accept relativism. In fact, I am sure one should not, because mankind's 
survival chances would thereby probably diminish. This is an age-old argument, 
but let me refer here to three more or less recent, important works once again 
formulating it. 

First, to The Rediscovery of Common Sense Philosophy by Boulter, stressing 
that "natural selection favours those organisms whose perceptual systems gener- 
ate visual perceptions which happen to correspond structurally more closely to 
that of the environment itself” (Boulter 2007: 114). Secondly, to Lynd Forguson's 
Common Sense, putting forward the "guiding idea" that "the individual members 
of our species would not get along as successfully as they do on this earth if 
their common-sense beliefs about the world [...] were not for the most part 
true" (Forguson 1989: iv). And thirdly, there is the devastating paper by Susan 
Haack, Reflections on Relativism, beginning with the observation: “Relativism’ 
refers, not to a single thesis, but to a whole family. Each resembles the others 
in claiming that something is relative to something else; each differs from the 
others in what it claims is relative to what" (Haack 1998: 149). Haack takes the 
side of common-sense realism, with a subtle version of her own she calls “in- 
nocent realism,” holding that “[p]erception is interpretative; but it is also direct” 
(Haack 1998: 161). 


2. Scientific vs. Common-Sense Realism 


What relations do obtain between common sense, common-sense realism, and 
scientific realism? The world of common sense is that of everyday time and 
space, of persons, objects, of observable entities, perhaps also of God, but on 
this latter point views begin to differ: William James believed the idea of God 
to be part of the common-sense world-view, G. E. Moore did not. Also, Moore 
held that common-sense truths were timeless, not open to revision by the prog- 
ress of science. Moores friend Wittgenstein, by contrast, tended to suggest 
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that the task of philosophy was actually to enable common sense to integrate 
the ever-evolving discoveries of the natural sciences. I understand Wittgenstein 
as striving to make the seemingly contradictory views of the scientist compat- 
ible with “the coarse views of the man in the street" (see Nyíri 2015 and Nyíri 
[forthcoming]). 

While the common-sense world is that of observable objects, modern sci- 
ence is positing unobservable entities in order to explain the observable world. 
Scientific realism holds that the unobservable entities posited by science are 
real. By implication, some or all of the entities of the common-sense world 
might turn out to be mere appearances. In an encompassing and profound 
analysis Sellars comes very close to conclude that the scientific image of the 
world will ultimately supplant the common-sense (the “manifest”) one (Sellars 
1963: 19, 27, 31 f., 36-39). By contrast, Michael Devitt in his brilliant book 
Realism and Truth argues that "scientific realism does not undermine com- 
mon-sense realism" (Devitt 1997: 5 and 81 f.). He believes that common-sense 
realism does not need to defend itself by having recourse to operationalism 
or instrumentalism - to positions maintaining that “unobservables are simply 
‘useful fictions”. These positions, in Devitt's view, require observability to have 
"an epistemic significance which it cannot have" (Devitt 1997: 127). Now I can 
agree neither with the main drift of the argument Sellars puts forward, nor 
with the particular point Devitt makes about instrumentalism. Enlightened 
common sense should not, and cannot, give up its primacy over science. And 
I suggest that we are indeed justified in taking some scientific theories to be 
purely instrumental; however, here our guiding criterion should be not observ- 
ability, but rather imaginability. We cannot imagine what we cannot visualize. 
We cannot visualize say quantum theory,’ or time as the fourth dimension of 
space. The limits of scientific realism should be drawn at the point where the 
possibility of visualization ends.* 


3 Devitt concedes that quantum theory is perhaps “not to be trusted at this stage as a 
guide to reality" (Devitt 1997: 132), but he does not formulate a general framework 
within which such a concession would naturally emerge. 

4 This is the position I argue for in my paper Visualization and the Horizons of Scientific 
Realism (Nyíri 2014: 21, 23 £., 30-33). 
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3. Seeing Is Knowing: Realism Defended 


Both "seeing" and "knowing" are words with a wide variety of meanings - the 
above subtitle is not meant as a well-defined proposition, it is just meant to convey 
the idea that by looking at the world we are gaining real knowledge of it^ 


3.1 The Visible World 


Our mind is attuned to seeing, because there is a world with visible properties. 
This common-sense assumption has been analyzed, and corroborated, by an ex- 
tensive and ramified body of literature. Here I have to restrict myself to just four - 
carefully chosen - references. The first one is to psychologist J. J. Gibson, who ina 
number of influential papers and books, from the 1950s on, formulated a new - he 
termed it "ecological" - theory of vision. In his essay New Reasons for Realism he 
explains that “[t]he structure of an array of ambient light from the earth" displays 
“invariants [...] specific to the substances of which objects are composed, to the 
edges of objects, and to the layout of their surfaces,” adding some pages later: 
"The doctrine of secondary qualities comes from a misunderstanding" (Gibson 
1967: 164, 170). My second reference is to Arnheim once more, in particular to 
his formula “The mind cannot give shape to the shapeless" (Arnheim 1969: 90), 
conveying a basic Gestalt message. Thirdly, I refer to the important 1995 paper 
on common sense by Barry Smith. Elaborating on Gibsons theory, Smith offers a 
sustained argument in favour of the idea that the colours, tones, shapes, etc., that 
determine our perceptions and actions are to be "conceived as qualities of external 
things" (Smith 1995: 647). And lastly, I come back to Boulter, whose “transcenden- 
tal argument for common sense in the domain of sense perception" again builds 
on Gibson. As Boulter concludes: “An external, pre-structured world is the source 
of the structure found in optic arrays. [...] Without a pre-structured world there 
is no visual perception" (Boulter 2007: 107, 111). Let us draw the threads together. 
We are justified to regard edges, surfaces, shapes and colours to be objective visible 
properties of an external world. 


5 A fascinating discussion of the topic “seeing” vs. “knowing” is given by Gombrich (1960, 
cf. there esp. pp. 12-14, 247 and 277 £); on p. 277 and on p. 357 in the corresponding 
note with reference also to Bernard Berenson' notorious book (Berenson 1953). 
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3.2 The Visual Road to Realism 


A royal road to acquire a grasp of the essential argument for visual realism and 
against visual relativism is to follow the journey of Gombrich from the first edi- 
tion of Art and Illusion (1960) to his final and devastating critique of Goodmans 
irrealism, in a talk he gave in 1978 (Gombrich 1981 [1978]). I have provided an 
overview of that journey in an earlier essay of mine, writing: 


1972 saw Gombrichs first direct attack on Goodman, the former's main contentions here 
being that "Goodman appears to think that the eye must be strictly stationary" whereas 
“no stationary view can give us complete information,’ and [on the other hand] that the 
pictorial technique of perspectival representation reflects something essentially natural 
and objective - it does not need to be learned to be decoded. The second, devastating, 
attack came six years later, with Gombrich's paper Image and Code: Scope and Limits 
of Conventionalism in Pictorial Representation, vindicating the common-sense idea of 
pictures as natural signs, and explicating the controversial concept of resemblance by that 
of equivalence of response. As Gombrich here momentously puts it: “the images of Nature, 
at any rate, are not conventional signs, like the words of human language, but show a real 
visual resemblance, not only to our eyes or our culture but also birds or beasts" (Nyiri 
2014 [2009]: 55 £.). 


A longer journey is the one beginning with the first generation of Gestalt psychol- 
ogists. I will just quote Wertheimer and Koffka. In 1923 Wertheimer wrote: “Our 
nervous system developed under the conditions of the biological environment; 
the Gestalt tendencies which were formed in that process do not by a miracle 
correspond to the regular conditions of the environment" A related observation 
by Koffka: “in reality our world is [...] not [...] a burlesque nightmare; as a rule, 
things are what they look like, or otherwise expressed, their looks tell us what to 
do with them, although as [...] optical illusion[s ...] show [...], perception may 
be deceptive" (Koffka 1955 [1935]: 76). 

Of the second generation, Arnheim was a leading member. He adhered to 
the Gestalt school's founding view that experiencing images necessarily involves 
experiencing the patterns of forces they embody and convey. This applied to the 
images provided by our physical environment, but also to mental images, as well 
as to artificial images such as drawings, paintings, photographs and of course films 
and videos. Discussing memory images, Arnheim called attention to the “[f]orces 
inherent in the shape itself"; analyzing children's and adult amateurs' drawings, he 


6 My translation. The original German runs: “Das Nervensystem hat sich unter den 
Bedingungen der biologischen Umwelt ausgebildet; die Gestalttendenzen, die sich 
dabei ausgebildet haben, sind nicht wunderbarerweise den reguláren Bedingungen 
der Umgebung entsprechend..." (Wertheimer 1923: 336 f.). 
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wrote of the "configurations of forces discerned in the draftsman's world and in- 
terpreted in his pictures" and the “constellation of forces that underlies the theme 
of the picture" (Arnheim 1969: 81, 259, 262). 


4. Conclusion 


In the wake of Arnheim, let me here make two comments which will bring me 
to the end of my paper. First, if the images provided by the world around us act 
like physical forces, then clearly they provide us with direct contact to reality. 
Secondly, reality can be depicted in various styles (Arnheim lays great stress on 
the realism of children’s non-naturalistic drawings), contemporary enlightened 
common sense however does indeed set priorities between those styles, accord- 
ing to the practical task at hand. Children might depict reality in peculiar ways, 
but we have no reason to suppose that the visual world seems different to them 
from the way it seems to us. To quote Devitt:“Why does the world seem the way it 
does? The obvious answer is that the world seems that way because it is that way; 
a correspondence easily explicable "along Darwinian lines" (Devitt 1997: 74, 78). 
To some animal species the world of course might even seem different. However, 
as Boulter points out: “The fact that an organism's perceptual systems do not pick 
up or respond to all of reality does not imply that what they do pick up are not 
objective features of an extralinguistic reality" (Boulter 2007: 103). 

To sum up: By integrating new scientific results, common sense is historically 
evolving. Still, contemporary enlightened common sense, guided by the philoso- 
phy of common-sense realism, has a conservative view of scientific discoveries: it 
does not accept the view that scientific change implies radical changes in ontology. 
Hence contemporary common sense does not have room, just as common sense 
never had room, for relativism. Common sense believes that it relies on the best 
available sources of knowledge. It understands that it might hold erroneous views, 
but trusts that progress will correct them. Epistemic systems different from its own 
it cannot but consider simply wrong. 
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Sybille Krámer 


Truth in Testimony: Or can a Documentary 
Film Bear Witness'? Some Reflections on the 
Difference between Discursive and 
Existential Truth 


1. Svjedok - The Witness (2012), a Film by Haris Bilajbegovic 


31 May 1992: A Bosnian village in the Sanski Most region of Bosnia-Herzegovina 
is raided by Serbian militiamen. The male inhabitants are then rounded up and 
forcibly led to a bridge. Four of the men have already been shot along the way; the 
others must jump individually from the bridge into the water. While swimming in 
the water they are then killed one at a time by volleys of gunfire. Only one man, 
Rajif Begic, survives this campaign of execution by removing his T-shirt after 
jumping in the water and allowing it to float downstream. While the T-shirt is 
riddled with bullets, he is able to save himself by concealing himself in bushes. Ten 
years after this event, Begic testifies before a tribunal in The Haag that is pursuing 
criminals in the Serbian army under the command of Goran Hadzic and Ratko 
Mladic. Begics statements lead to the conviction of the principal offenders who 
directly participated in the bridge murders. The survivor of a war crime becomes 
its only and most relevant witness. 

An Austrian with Bosnian roots, Haris Bilajbegovic, filmed a documentary 
about this event, in which he himself lost an uncle, and his Bosnian grandfather 
thus lost a son. His film Svjedok - The Witness premiered in 2012. The film was 
nominated for the German Human Rights Film Award, is available on DVD, and 
can be seen on Youtube. It was broadcast on Austrian television on the 20th an- 
niversary of the Srebrenica massacre on July 25th, and was broadcasted again on 
July 30th, 2015. Rajif Begic's story constitutes the chronological axis of the film, 
and he is mostly filmed in close-up, like in interviews with Holocaust survivors. 
Within the film Raijf Begic also performs a plurality of witness functions at the 
same time: The film incorporates archival recordings of his testimony before the 
international criminal court, in which he serves as a legal witness. In the close-ups 
of his face and hands filmed in the studio, he reports on the event as a contempo- 
rary witness. He also walks through the original locations where the event took 
place and thus acts as a witness of “oral history”. As a survivor, he also finds himself 
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in the position of a moral and political witness who attempts to give a voice to 
those who were silenced by death. 

Furthermore Begic' descriptions are followed by a reenactment of scenes of 
the event," which are staged like a feature film; the roles of the victims and the 
perpetrators are played by the inhabitants of the raided village themselves, and 
these scenes are filmed at the original locations where the event took place. Lastly, 
these scenes are intercut with shots of skeletonized remains that were excavated 
from the area around the bridge and later evaluated as DNA traces that match the 
victims of the massacre; their deaths are thus "proven" through evidence. 

The film claims to depict a real event, as what it represents is factual rather 
than fictional. 

But is it even possible for a film to raise a truth claim? What we see is an artifi- 
cial world of moving images: actors performed the events reported by the witness 
in the film. These scenes were also staged, edited, combined, and assembled by 
the filmmaker. As a produced artwork, the film belongs definitely to the realm of 
the fictional. What entitles us to think that the events presented in the film are 
established facts that we truly know and not only believe after watching the film? 


2. On Truth 


Since Gottfried Wilhelm Leibniz, the concept of "truth" is seen as the truth not 
of things but rather of propositional sentences (Leibniz 1966: 15-21). Truth is as- 
sociated with language. The pragmatic philosophy of language of the twentieth 
century made this insight even more radical: truth is assigned not simply to sen- 
tences but rather to statements produced in communicative, dialogical situations. 
A question of truth only emerges when the truth claim of a statement is doubted 
by someone else, and grounds for justification must or at least can then be given. 
I will call this the discursive or propositional truth, which has two characteristics: 


(i) Inthe case of a truth statement, it must be possible to separate its genesis and 
validity. In other words, the grounds for justification must be independent 
of the individual history of the person who justifies the statement as well as 
the specific situation in which something was recognized and discovered. 
Truth is something that not only matters from the subjective perspective of 
a speaker but is also objectively valid from a third-person perspective. 

(ii) If objective truth is connected to the medium of language, then it is “located” 
in a speech act in which one person claims something to another. Visual 


1 Fora discussion of artistic reenactment practices see Lütticken ed. 2005. 
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images or films are characteristically different from languages - for example, 
images cannot negate something. According to this discursive concept of 
truth, images cannot be carriers of truth. 


3. The Dilemma of Witnessing 


When viewed from the perspective of the discursive concept of truth, the act 
of bearing witness leads to a dilemma. Witnessing is necessary when there is 
uncertainty about the course of events: someone who was physically present at 
the event reports his or her perception of the situation, and he or she does this 
in the presence of addressees, who have no access to the past event themselves. 
The subjective experience of the situation is expressed in an intersubjectively 
understandable language so that the jury judges or accepts the testimony of the 
witness to be true. Witnesses witness by saying something. This constitutes the 
core of our understanding of witnessing. 

However, the verbalization of an experience opens up the possibility of errors 
and lies. Practices like oaths and vows in legal contexts - even though they are 
disappearing - point to this problem. At the same time, we know that nothing 
is as susceptible to error as a witness report (Ross-Read- Toglia ed. 1994). It is 
empirically certain that half of all eyewitnesses are wrong. Every testimony thus 
has the potential to be false, and this possibility becomes even more precarious 
when a witness is the sole witness. The dilemma associated with eyewitnessing 
can be expressed this way: speaking the truth constitutes the foundation and 
function of witnessing, yet at the same time nothing is as fallible and prone to 
error as witness testimony. 

Itis no wonder that the claim to truth of testimony is fundamentally questioned 
in philosophy - and from entirely differently positions (for an overview: Gelfert 
2014: 95-124; Fricker 1995). In the context of an individualistic conception of 
knowledge, according to which everyone must be able to justify what he or she 
knows through his own cognitive resources, no knowledge can be transmitted 
through the words of others. Testimony is only epistemically valid when its receiv- 
ers are able to verify the claims of the witness with their own epistemic abilities, 
such as memory, perception, and reasoning. Its consequence is a philosophical 
skepticism with regard to testimony: witness statements do not create objective 
knowledge unless the transmitted information can be traced back to other forms 
of evidentiary and corroborating knowledge in the third-person perspective. It 
is only in this case that there is a separation possible between origin and validity. 

Jacques Derrida also questions the claim to truth of testimony, as it creates not 
a fact but rather a fiction (Derrida 2000: 147-182; Derrida 2003). Witnessing thus 
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requires an act of belief on the part of the listener. ^I testify" means *you must 
believe me" (Derrida 2000: 159). Derrida separates testimony from the realm of 
knowledge and moves it into the domain of belief, the relation to truth of witness 
testimony is thereby eliminated. 

Traditional skepticism with regard to testimony and the poststructuralist fic- 
tionalization of testimony thus converge in the problematization of the truth 
content of witnessing. Testimony does not create evidence, and it is not proof - 
otherwise it would no longer be testimony. It is impossible to separate what the 
witness communicates from his or her own personal perception and experience. 
The irreversibility of the past event combined with the first-person perspective of 
the witness's perception of the event makes it impossible for witness knowledge to 
be independently verified and justified. This is the epistemic dilemma of testimony. 

But is this combination of speech act, evidence, proof, justification, and truth 
the only possible form of truth that can play a role in witnessing? 

I want to argue that there is another significant form of truth involved in wit- 
nessing, which is not attributed to verbal statements but rather to people. Moreo- 
ver, the specific quality of this form of truth is that it cannot be stated, but rather 
"only" shown and thus made visible. But how is this other form of truth to be 
understood (Krämer 20162)? 


4. Existential Truth: Soren Kierkegaard 


Kierkegaard develops two concepts of truth, which are derived from the differ- 
ence between "knowing a truth" and “being a truth" (Kierkegaard 2012: 215). In 
so far as truth is linked to knowledge it can be formulated in language; methodi- 
cally acquired and justified; intersubjectively transmitted, taught, and learned; and 
embodied in text and speech. However, the kind of truth that Kierkegaard sees 
embodied by Jesus in his religious role as Christ is entirely different. This form of 
truth has a performative dimension, as it cannot be taught but rather only lived; 
its existence is thus shown and then (re)enacted by other people in their own lives 
(Kierkegaard 2012: 214). 

This is a truth that is inseparable from the path by which it is acquired. With 
questions of knowledge - according to Kierkegaard - the discovery of a new find- 
ing is supposed to be time-consuming; once it is part of the knowledge system, 
it is no longer necessary for others to follow the path of its discovery. Truth that 
consists in being rather than knowledge is different, however, as its origin and 
validity cannot be separated and it is not predicated on propositions but rather 
on people. I will call this “existential truth". 
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For Kierkegaard, the aim of "witnessing? is this existential truth. In religious 
testimony, for example, Christ does not speak the truth but rather shows it (Ki- 
erkegaard 2012: 213). This testimony requires its listeners to believe. 

Kierkegaard thus does not open up Derridas opposition between knowledge, 
which is capable of truth, and belief, which is not. The sphere of belief itself char- 
acteristically involves an "either/or" decision that cannot be resolved by thought, 
reason, method, and knowledge; rather, it is a situation that requires a "leap? 
For Kierkegaard, the origin of ethics lies precisely in this absolutely understood 
"either/or" (Kierkegaard 1998: 727). Yet, if believers lack a guiding method, then 
how is this either/or to be decided? What is the determining factor in the choice 
between different possibilities? 

Kierkegaard's answer is "authority" (Kierkegaard 2012: 302). Authority is the 
attribute of a person who speaks and acts in the name of an entity that transcends 
the individual. In its weak form it is the authority conferred by an office or the 
authority of parents with respect to their children. In its strong, paradigmatic form 
it is the religious authority of the apostles, which is based on being the emissar- 
ies of a message that they themselves did not create: they speak and act not on 
their own behalf but rather in the name of an entity who has authorized them 
(Kierkegaard 2012: 301-315). 


5. The Second Person Model of Witnessing 


It is surely irritating that this kind of truth is not propositional, that it only mani- 
fests in reallife, that it requires a leap into uncertainty, and that its only guarantee is 
belief in an authority. Yet this conceptual constellation intersects at an interesting 
point with the contemporary postanalytic debate over testimony - albeit without 
reference to Kierkegaard and with the crucial difference that concepts like testi- 
mony, authority, trust, and belief can actually generate a form of knowledge. This 
is the second person model (McMyler 2011: 91-112). 

Remember that knowledge from the third-person perspective means that a 
speaker can give reasons for his assertion, which listeners can understand and 
recognize. If this is the case, then the knowledge that arises is based on evidence. 
However, the second person model assumes that there are legitimate forms of 
knowledge that are not based on evidence and thus grounded in the third-person 
perspective. The second person model deploys a social theory of knowledge: as 
a result, evidence is replaced by concepts of social interaction, such as "trust" 
and "authority". Thomas Reid already demonstrated that knowledge is a "social 
operation of the mind" (Reid 2002: 68). Individuals are not epistemically au- 
tonomous, but rather mind and knowledge emerge through cooperative social 
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activities.” The social theory of knowledge generation emphasizes that "telling" 
- the transmission of content via speech, image, and writing - can still be accepted 
as knowledge without independent verification and justification. This "telling" 
takes many forms: it begins when we ask strangers for the time, when we hear news 
on television, when we divide numbers without understanding why the division 
algorithm works, and when we obtain information through Wikipedia or printed 
encyclopedias. It also occurs when bearing witness to perceptions to addressees 
who were not present at the perceived event. Telling is not arguing (Moran 2005: 
1-29): it does not provide reasons for what is told, and the audience is not able to 
judge the truth content of what is told on their own. This is precisely the situation 
of our epistemic dependence on the knowledge of others (McMyler 2011: 142). 
It does not negate the creation of knowledge from testimony, but rather it defers 
its justification. The speech act of the witness is notan assertion, but rather an as- 
surance (Moran 2005: 7). The witness gives the audience a guarantee that he will 
assume responsibility for his statement if problems and doubts should arise. As 
with every guarantee, it thus concerns future behavior. The authority of the witness 
consists precisely in issuing a guarantee for his own statement. And the audience 
recognizes this authority if and only if it accepts this guarantee, trusts the witness, 
believes in him, and accepts the truth of his testimony (McMyler 2011: 113-140). 

Kierkegaard's belief in the religious authority of the apostles as the emissaries 
of God thus became trust in the epistemic authority of the witness as the emissary 
of an experience that the listeners do not share. In the case of witnessing, however, 
there is one crucial condition that enables the social configuration of assurance, 
authority, trust, telling, and believing and creates new knowledge: the witness must 
not only speak, but also address his listeners directly. The realization of authority 
and trust as complementary sides of a reciprocal social relationship in the form 
of the second person model is thus based on the direct speech associated with 
the telling of testimony. 


6. A Documentary Film as Testimony? 


This brings me back to the film Svjedok - The Witness. 
A documentary film claims that what it shows is not invented but rather found. 
For Dirk Eitzen, the crucial criterion for distinguishing between documentary 


» 


and fictional films is the question “could it be a lie? At the same time, Eitzen also 


2 For the foundational function of cooperation and agreement see: Kusch 2002. 
3 “A documentary is any motion picture that is susceptible to the question ‘Might it be 
lying?" (Eitzen 1998: 13). 
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emphasizes that the genre boundary between documentary and fictional films is 
ambiguous, as it depends on whether recipients interpret a film as real or fictional. 
Accepting a film as a documentary means that the public trusts the film and the 
filmmaker. 

The phenomenon of witnessing is linked to documentary films through the 
uncertainty concerning the reality content of a spoken or filmic statement and 
the trust that is either given or refused to a witness or a film. I argue that the film 
Svjedok - The Witness introduces a third possibility with respect to the *mere" 
documentary film, on the one hand, and the “mere” witness statement given in 
the physical presence of receivers, on the other hand, in so far as it is not simply a 
documentary film but it also provides testimony. The hypothesis, therefore, is that 
the film Svjedok - The Witness not only filmically represents the act of bearing 
witness but is itself also a testimonial (Krámer 2016b). 

But how can a film that - from a media-technical perspective - is undoubt- 
edly staged by the filmmaker and addressed to an anonymous public, who must 
forego the co-presence between the witness and the audience that is constitutive 
of witnessing, nevertheless bear witness? 

Keep in mind that eyewitnesses do not simply act as causal tracers of an event - 
if that were the case, they would function as evidentiary proof; rather, eyewit- 
nesses act symbolically by means of linguistic representations, and it is precisely 
this speech act - the discursification of their experience - that opens up the pos- 
sibility for error or even intentional lies, while at the same time allowing them 
to assume responsibility for and offer a guarantee of the truth content of their 
speech. The truth content of testimony is always only “promised” and “assured,” 
but never made evident as proof. 

The witnessing film functions in a similar way, as the staged and composed 
sequences of images cannot be proof of truth, but they can raise a claim to reality 
insofar as it is self-referentially marked in the film that the world it symbolically 
generates and presents is just like the real world. Viewers should not perceive 
the film as real in the sense of a photograph, which is impressed as a trace on a 
sensitive surface by a constellation of light and a chemical reaction at a specific 
moment in time. Rather, the film should be seen as if it is the reproduction of a 
historical event. This “as if" highlights a gap that cannot be skipped over and a 
persistent uncertainty on the part of viewers. This is precisely the “usual” situation 
of an audience faced with witness statements: the speech of witnesses is supposed 
to be perceived as if it were true, yet without the certainty that it is. 

Remember that the second person model overcomes this veracity gap in that 
testimony does not function as proof, but nevertheless transmits knowledge by 
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virtue of the personal address of the witness, which transforms his statement into 
the promise of a guarantee. Yet this is precisely foreclosed by the mass-media 
construction of the film and the anonymization of the public. 

Could there be a filmic equivalent of the cooperative social relationship be- 
tween a witness and his audience? One answer comes to mind: couldnt the film- 
maker, as the author of the film and the representative of the witness, stand surety 
for the promise of truth connected with his film? This would be a classic case of 
"secondary witnessing" - a concept developed in connection with survivor testi- 
monies, particularly in relation to the Holocaust. 


7. Secondary Witnessing? 


The often-cited last line of Paul Celans poem Ashes-Glory claims that “no one 
bears witness for the witness; yet the empathic and often videographic “work” 
with survivors of the Holocaust is based on the guiding principle of secondary 
witnessing (this concept goes back to de Pres 1976 and Langer 1991; Laub 1992: 
75-92). According to the proponents of this idea, the experience of violence trau- 
matizes its victims so intensely that they can only be brought to articulate their 
experience through active, empathic listening. The person who appeals to the 
witness thus becomes a co-producer of the testimony,* which gives rise to a kind 
of "representative witnessing" (Weine 2006: 11). 

But this approach to survivors poses a problem. However much the self-under- 
standing of the interviewer as co-creator is necessary in clinical and therapeutic 
contexts (see Weine 2006), the self-empowerment of the "representative witness" 
or secondary witness remains problematic. Is the “earwitness” supposed to be“the 
redeemer of the eyewitness" (Schneider 2007: 65)? Concepts like "representative 
witnessing" tend to negate the difference between those who were exposed to 
traumatizingly violent situations and those who were not. The sublime structure 
of witnessing, which is based on the gap between the witness, who is physically 
and psychologically involved in an event, and the addressee, for whom the past 
event embodies an inaccessible past, thus collapses in a way that to some extent 
levels the unattainable position of the witness. 

"Secondary witnessing” cannot compensate for, much less suspend, Paul Celan’s 
"^no one bears witness for the witness". 

Questioning the relationship between the filmmaker and the interviewed and 
filmed survivor witness nevertheless points in a compatible direction. 


4 “[T]estimony must be co-created by a survivor and an authoritative listener [...]" and 
"the listener actually knew more than the survivor" (Weine 2006: 33). 
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I argue that Svjedok - The Witness can be understood as not only a documen- 
tary film but also a form of "testimony" because the medium of film instantiates 
a social relation between the survivor witness and the filmmaker. This is not the 
contract-oriented relation between an actor and a producer or the secondary wit- 
nessing of the filmmaker with respect to a victim and a survivor. Rather, the way 
the filmmaker made the film demonstrates his trust in the witness’s description 
of the events. The film is thus a testimony not to the catastrophic event that it su- 
perficially depicts - the witness report of a war crime - but rather to the profound 
friendship and personal connection between the witness and the filmmaker. The 
style of the film embodies a form of sociality that - communitarianly extended 
(Froger 2014: 73) - can also make the viewers part of the community created by 
the film; a community whose bond is the political-ethnic solidarity created by the 
survivor testimony in the film. 


8. Summary 


Is it sufficient to say that the film Svjedok — beyond what it implies about the 
documentation of an event - consists in the creation of a social relation between 
the filmmaker and the witness, and that this social relation also “invites” viewers 
to establish this kind of connection? 

The creation of communitarian connections through the viewing of documen- 
tary films goes back to Marion Froger. She refers to the cultural-anthropological 
phenomenon of the gift: with some documentary films, the "informational value 
of the image" recedes behind the films function to create a “communitarian con- 
nection" between the filmed person, the filmmaker, and the film viewer (Froger 
2014: 76). 

Gifts make relationships.? In terms of social anthropology, the gift is an act that 
creates a form of community that is not based on the validity of conventions, rules, 
and laws. Rather, it creates social relations that differ from the functional relations 
regulated by law, politics, and the economy and that produce instead a sense of 
mutual closeness, which is typical of spatial, neighborly, familiar, and ethnic com- 
munities. Friendship paradigmatically embodies such an “unregulated” sociality. 

The executions that took place on the bridge, which took the lives of Raijf 
Begic’s brothers and Haris Bilajbegovic’s uncle, accidentally brought them into 
a fateful connection. Through the film this accidental connection becomes an 
intentional collaborative project, in which they both follow the impulse to give a 


5 On the relationship between giving and testimony see Derrida 1994. 
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voice to the Bosnian war dead. The film thus creates a second-person relationship 
that can be described in terms of "giving": Haris Bilajbegovic gives the surviving 
witness a filmic space of public attention for his story, and he bestows almost blind 
faith in what the survivor reports by staging the reconstructed scenes in a "live" 
mode that conveys a sense of the real presence of true events. He also contributes 
to its documentary authenticity by simultaneously embedding evidence and ar- 
chived recordings into the story. 

Conversely, Raijf Begic's story gives an answer that the filmmaker had long 
sought in order to be able to reconstruct the event on the bridge, which also af- 
fected his family. The survivor thus entrusts himself to the filmmaker as a person 
who is intimately familiar with the means of representation: he exposes himself 
through this disclosure and reveals himself to the anonymous public. It also takes 
courage to admit to being an eyewitness twenty years after the crime and to con- 
tribute to the conviction of the perpetrators in The Haag. 

The filmmaker and the witness are both giving; they are also both receiving. 

The production of the film thus establishes a network of consent for those 
who took part, which also includes the inhabitants of the Bosnian village who 
performed in the staged scenes and whose roles were divided into those of victims 
and perpetrators. Making the film and participating in the film is an act of connec- 
tion, perhaps even an act of friendship, but in any case an act of social cooperation, 
political articulation, and ethnic identification. What is verified is not simply a 
testimony, but rather a social relation that emerges in and through the film. 


References 


Derrida, Jacques (2000): A Self-Unsealing Poetic Text. Zur Poetik und Politik der 
Zeugenschaft. Translated by K. H. Nielsen. In: Baumann, Peter (ed.): Zur Lyrik 
Paul Celans. München: Fink. 147-182. 

Derrida, Jacques (2003): Bleibe. Maurice Blanchot. Wien: Passagen. 

Derrida, Jacques (1994): Zeugnis, Gabe. In: Weber, Elisabeth (ed.): Jüdisches Den- 
ken in Frankreich. Frankfurt a. M.: Suhrkamp. 

Eitzen, Dirk (1998): Wann ist ein Dokumentarfilm? montage/AV 7/2: 13-44. 

Fricker, Elizabeth (1995): Telling and Trusting: Reductionism and Anti-Reduc- 
tionism in the Epistemology of Testimony. Mind 104 (441): 393-411. 

Froger, Marion (2014): Die Gabe und das Bild der Gabe. Dokumentarische Ästhe- 
tik und Gemeinschaft. Zeitschrift für Medienwissenschaft 11: 65-78. 

Gelfert, Axel (2014): A Critical Introduction to Testimony. London etc.: Blooms- 
bury. 


Truth in Testimony 39 


Kierkegaard, Sóren (2012): Einübung im Christentum. Zwei kurze ethisch-re- 
ligióse Abhandlungen. Das Buch Adler. Edited by Walter Rest. Second edition. 
München: Deutscher Taschenbuch Verlag. 

Kierkegaard, Sören (1998): Entweder - Oder. Part I and II. München: Deutscher 
Taschenbuch Verlag. 

Krämer, Sybille (20162): Spur, Zeuge, Wahrheit. Zeugenschaft im Spannungsver- 
hältnis zwischen diskursiver und existenzialer Wahrheit. In: Däumer, Matthias - 
Kalisky, Aurelia - Schlie, Heike (eds.): Über Zeugen: Szenarien von Zeugenschaft 
und ihre Akteure. München: Fink. 

Krämer, Sybille (2016b [forthcoming]): Svjedok - Der Zeuge (2012), oder: Kann 
ein Film ein Zeugnis sein? In: Krámer, Sybille - Schmidt, Sibylle (eds.): Zeugen 
in der Kunst. München: Fink. 

Kusch, Martin (2002): Knowledge by Agreement. Oxford: Oxford University Press. 

Langer, Lawrence L. (1991): Holocaust Testimonys. The Ruins of Memory. New York: 
Yale University Press. 

Laub, Dori (1992): An Event without a Witness: Truth, Testimony and Survival. 
In: Felman, Shoshana - Laub, Dori (eds.): Testimony: Crisis of Witnessing in 
Literature. Psychoanalysis and History. New York-London: Routledge. 75-92. 

Leibniz, Gottfried Wilhelm (1966): Dialog über die Verknüpfung zwischen Dingen 
und Worten. In: Leibniz, G. W.: Hauptschriften zur Grundlegung der Philosophie. 
Vol. I. Hamburg: Meiner. 15-21. 

Lütticken, Sven et al. (eds.) (2005): Life, Once More: Forms of Reenactment in 
Contemporary Art. Rotterdam: Witte de With. 

McMyler, Benjamin (2011): Testimony, Trust & Authority. Oxford: UP. 

Moran, Richard (2005): Getting Told and Being Believed. Philosophers Imprint 
5: 1-29. 

Pres, Terrence de (1976): The Survivor. The Anatomy of Life in the Death Camps. 
New York: Oxford University Press. 

Reid, Thomas (2002): Essays on the Intellectual Powers of Man. University Park: 
Penn State UP. 

Ross, David F. - Read, Don J. - Toglia, Michael P. (eds.) (1994): Adult Eyewitness 
Testimony: Current Trends and Developments. Cambridge: Cambridge UP. 

Schneider, Christian (2007): Trauma und Zeugenschaft. Mittelweg 36/3: 59-74. 

Weine, Stevan (2006): Testimony After Catastrophe. Narrating the Traumas of Po- 
litical Violence. Evaston, Ill.: Northwestern University Press. 


Valeria Giardino 


Space and Action to Reason: 
from Gesture to Mathematics 


1. The Target: Tools for Thought 


In our cultural evolution, humans have created several instruments, not only with 
the intention of surpassing their physical limits - think of a hammer or a pair of 
glasses - but also with the aim of enhancing their memory and inferential powers; 
consider for example a map or the abacus. In the present paper I will focus on 
tools for thought. How do they work? Or, to clarify, how do we work with them? 

In her article in the fourth volume of the Series Visual Learning, Krámer (2014) 
has pointed out that the human sciences have generally focused on a crucial di- 
chotomy between word and image. However, tools for thought do not seem to fit 
this binary ordering: tables, graphs, diagrams or maps, arise as a "conjunction of 
language and image,’ which is very powerful since it makes "saying" and “showing” 
work together, thus reaching beyond the word/image binary opposition. Such a 
conjunction establishes an "operative iconicity": cognitive artefacts are not only 
intended as representations (a map represents a city and a Venn diagram rep- 
resents certain logical relations) but they are also inviting their user to rely on 
them as instruments to generate and further explore the represented objects of 
knowledge (we navigate the city through a map and we extract new logical rela- 
tions by reconfiguring a Venn diagram). 

Writing as well can be considered a cognitive artefact.! Goody (2000) took 
the experience of the protagonist of Defoe’s Robinson Crusoe as paradigmatic: it 
is only where he finds pen, ink and paper that he finally begins "keeping things 
very exact, most of all by telling the time. In Goody's view, writing has been a 
crucial improvement in our cultural evolution, since it has influenced not only 
the content of our exchanges but their very structure. The drawing of the line 
has been a graphic accomplishment that has changed forever the way we formu- 
late our thoughts (think for example of the line constituted by the carvings in a 
stone to track days passing by). Writing and the drawing of conceptual lines are 


1 Inthe following, I will use cognitive artifact as synonym for tool for thought. However, 
it is true that there might be cases of tools for thought that are not strictly speaking 
artifacts, for example gestures. 
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phenomena that cannot be considered from within the word/image dichotomy. 
Despite this, operative iconicity brings about a form of "cognitive technology" 
that becomes available for sharing and structuring the content of our thoughts. As 
Goody suggests, we could think for example of the mathematical table - certainly 
a product of writing but more interestingly of the drawing of the graphical line - as 
a tool for thought whose functioning can be taught to and learned also by people 
who can neither read nor write. The table here is “a technology for the intellect"; 
in KrámerS words: it belongs to the class of the “diagrammatic,” overcoming the 
word/image dichotomy. 

In the present paper, I will assume that "operative iconicity" is indeed the char- 
acteristic feature of numerous tools for thought and my aim will be to explain the 
conditions for it. In Section 2, I will introduce my hypothesis about the existence of 
a human capacity labelled diagramming. In Section 3, I will discuss diagramming 
in relation to the philosophy of mind. In Section 4, I will present some pieces of 
evidence coming from experimental psychology and philosophy of mathematics 
supporting the diagramming hypothesis. Finally, in Section 5 I will briefly discuss 
some open questions. 


2. The Hypothesis: Diagramming 


Inan article in the fourth volume of this series, I introduced my hypothesis about 
the existence of a capacity that I have labelled diagramming (Giardino 2014). 
Thanks to this capacity, humans are able to recruit a variety of cognitive systems - 
spatial perception and action systems - that are already available in other contexts, 
with the specific aim of reducing cognitive loads for memory and assisting prob- 
lem solving. The human species is endowed with natural capacities for treating 
spatial information and planning/regulating action in the external world, which 
have an undisputable survival value. In my view, by connecting the systems re- 
sponsible for spatial perception and action - and possibly other systems - humans 
have invented a class of (cognitive) artefacts capable of assisting them in solving 
new problems originated in the course of their cultural evolution - the nature of 
which would have made it impossible to address them using one of those systems 
alone.In particular, according to my hypothesis: (i) the production and the analy- 
sis of spatial cognitive artefacts recruit action systems; (ii) in some cases, recruiting 
action systems makes problem solving easier (problems are solved more efficiently, 
more quickly, and with less cognitive efforts); (iii) spatial cognitive artefacts trigger 
this recruiting and therefore they act as multi-recruiting systems. 

Inline with Krämer, I argue that to give an account of the functioning of cogni- 
tive tools it is necessary to go beyond the dichotomy word/image. In fact, spatial 
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cognitive artefacts are not simply visual tools but dynamic devices, allowing for 
new inferences by being acted upon; tools for thought are the medium where space 
perception and orientation, action planning and regulation and other cognitive 
systems (e.g. visual and conceptual) operate in coordination in view of a cognitive 
task. For this reason, they can gain us a unique insight on the functioning of the 
human mind and on its motives and capacities for cultural innovation. 

Imagine performing an action on a geometric figure, such as translating or 
rotating it. This will bring together various cognitive systems by triggering each 
of them: in that same action, the conceptual system will recognize the conformity 
to some invariance; the visuo-spatial system a transformation in time; and the 
action system a movement or a movement plan (Giardino 2014). The connection 
among these different perspectives will allow for the performance of the appro- 
priate inference. Thanks to diagramming, the physical properties of a particular 
representation are interpreted as referring to other elements - abstract as well - 
which are not directly present in the space of the representation: by manipulating 
physical properties, it will be in some cases possible to learn something new about 
the objects or the events which they refer to. The products of the diagramming 
capacity are "iconic; that is, conceived to structure the space of the problem. By 
using the term "iconic; the reference is to the notion of “icon” as introduced by 
Peirce. As Peirce suggests, a “diagram-icon’ is a tool that allows making inferences 
because it has been constructed with an intention and is dynamic: the diagram- 
icon leads its interpretant to a state of activity that, mingled to curiosity, brings one 
to experimentation (Peirce [c. 1906]). It is an “operative iconicity, to use Krámer's 
term again. 


3. The Background: Moderate Embodiment 


In the recent philosophical literature, various hypotheses about the nature of 
our mind have been put forward that are possibly in line with the diagramming 
hypothesis. For example, Varela et al. (1991) have proposed that the mind is em- 
bodied, and Clark and Chalmers (1998) that it is extended. Despite being very 
inspiring, the metaphors of the mind as embodied or extended do not seem un- 
fortunately to be enough when it comes to clarifying, in practice, how humans 
were able to create and are able to rely on ‘scaffolding’ structures in order to en- 
hance their reasoning and inferential capacities. I do not take here any particular 
metaphysical stance about the location of the mind in the environment; more 
modestly, I claim that cognitive processes do not happen exclusively in the brain 
but extend themselves beyond the skin and skull of an individual, and therefore 
cognition happens to be distributed between internal and external structures, for 
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example, in space (see for reference Hutchins 2001). It still remains to evaluate the 
possible role of the body: how much the experience of having a particular body 
would matter for the performance of a variety of cognitive tasks? 

On this topic, Goldman (2012) has interestingly proposed to assume a moderate 
approach to embodied cognitive science. According to Goldman, empirical studies 
show that human cognition can in fact be considered for the most part as em- 
bodied because information obtained from proprioception and kinesthetics (which 
refer in the first place to the perception of the position and of the movements 
of the different parts of the body), happens to be often reused for other, more 
abstract tasks. The empirical part of Goldmans claim is that there exist so-called 
bodily representational codes, that is, a subset of mental codes that are primarily 
or fundamentally applied in forming interoceptive or directive representations 
of ones own bodily states and activities (see for reference Goldman-Vignemont 
2009). The philosophical part of Goldman’s claim is that the brain reuses or re- 
deploys cognitive processes having different original use to solve new tasks in 
new contexts; when it comes to bodily representational codes, these appear to 
be extremely pervasive: selected cognitive tasks might be executed via embodied 
processes, and there is no need to ascend to more global claims. 

Goldmans proposal leads to a moderate" conception of embodiment-oriented 
cognitive science precisely because it specifies the role of the body in cognition, 
first by defining what bodily representational codes are and then by explaining 
how they happen to have an influence on some cognitive processes. This frame- 
work is crucial to consider diagramming as allowing us to perform actions on 
material spatial artefacts, leading to cognitive advantages in some particular tasks. 
Such a view runs counter to standard theories in cognitive science, which have 
claimed that core knowledge representations in cognition are amodal data struc- 
tures that get processed independently of the brain's modal systems for perception, 
action and introspection. 


4. Some Evidence from Mathematics 
4.1 Gestures in Explanation 


What if mathematics in particular is (moderately) embodied? As a first piece of 
evidence in favour of the existence of the diagramming capacity, consider gesture 
in mathematics. According to standard approaches, mathematics is an abstract 
science, dealing with abstract objects described by signs not sharing any properties 
with the ordinary objects we interact with every day. However, some recent studies 
have questioned the existence of a sharp distinction between abstract knowledge 
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on the one hand and the concrete world on the other. According to Lakoff and 
Nünez (2000), abstract mathematical concepts are rooted in embodied activities, 
such as for example our ways of thinking about the world, and how we describe it, 
that is, our perception. In line with previous studies on language (see for reference 
Lakoff-Johnson 1980), the authors propose that abstract scientific concepts, as 
well as ordinary ones, can be reformulated in terms of metaphors, which are not 
mere linguistic phenomena, but crucial elements of thought. Indeed, the typical 
mathematical jargon contains many terms that allude to our relationship with the 
real world: natural numbers “grow” indefinitely, points “lay” on a line, functions 
"move" to zero. The basis of these metaphors is bodily experience: mathematics is 
embodied because we understand and explain it by making appeal to embodied 
cognitive mechanisms, of which conceptual metaphor is the main one. 

Recently, Sinclair and Gol Tabaghi (2010) have interviewed six mathematicians 
and asked them to explain the meaning of the mathematical concept of “eigenvec- 
tor”. The interviews were filmed, with the aim of evaluating the mathematicians 
embodied reasoning. The videos show that the mathematicians make use of a 
variety of representations - speech, gestures, diagrams, and so on - moving from 
one to the other without difficulties, thus blurring the alleged boarders between 
the mathematical and the physical world. They all well know the formal ‘manual’ 
definition of eigenvector, single, atemporal and static; nonetheless, without ex- 
ception, they offer a description of eigenvectors that alludes to a very different 
interpretation, including also temporal and kinaesthetic elements, as shown both 
in the terms and in the gestures they use. Metaphors are common: some of the 
mathematicians focus on the transformations of the vectors, by saying and show- 
ing in their gestures how they "shrink" or “turn”; others describe the vectors per- 
sonality, by claiming that they “go in the same direction,’ they ^align;' and so on. In 
other words, none of the mathematicians speaks of eigenvectors only in terms of 
algebraic equalities. Moreover, some metaphors are perceptual (for example, one 
mathematician thinks of the quadratic function as a "goblet") but most of them 
have a movement component. Furthermore, the high variability in their gestures 
seems to depend on their respective education and competence, i.e. on their rel- 
evant background knowledge. Gestures, compared to language, are in some sense 
the degree zero of diagramming: they give more possibilities than simple speech 
to express continuity, time and movement, thus confirming the intuition of the 
French mathematician Chátelet (1993), who saw in a mathematical diagram the 
"crystallization" of a gesture. 
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4.2 Formulas in Algebra 


A second piece of evidence in favour of the existence of diagramming comes 
from recent experimental work on mathematical notations. Landy and Goldstone 
(2007) have considered how physical layout affects the segmentation of simple 
equations. A difficult and yet routine part of mathematical reasoning is to segment 
a notational form, that is, to parse it into its formal components. For example, in 
a formula, in the absence of parentheses, multiplication comes before addition, 
and therefore the equation must be parsed accordingly. Following the standard 
approaches to mathematical reasoning, the cognitive parser executes segmenta- 
tion by applying formal rules to individual notational symbols; the assumption 
is that abstract symbol sequences are trivially extracted from physical notations. 
To run counter to this assumption, the authors added several visual cues such as 
spacing, lines or circles to the formulas of an equation and then showed them to 
their subjects. The hypothesis was that such cues would trigger the application of 
perceptual grouping mechanisms and as a consequence the capacity for symbolic 
reasoning. The results showed indeed that the subjects’ judgments about the valid- 
ity of the equations were more likely to be correct if visual groupings were in line 
with valid operator precedence (multiplication must be executed before addiction 
in the absence of parentheses). This would give evidence to the authors’ hypoth- 
esis that people use typically available non-formal information to make grouping 
judgments, and only subsequently integrate this information with formal rules, 
which is in line with diagramming. 


4.3 Diagrams in Topology 


A third piece of evidence in favour of diagramming comes from my research 
about visual tools in topology. Several philosophers have discussed the use of 
diagrams in mathematics (Giardino [forthcoming]): mathematicians often rely 
on the space of the representations they use in some cases by performing some 
actions on them. Space is crucial for reasoning: as it is well known, in the 1980s 
Johnson-Liard (1983) proposed a theory of human reasoning that was based on 
mental models, that is, human reasoning would be a mental simulation process 
in which models of the premises are constructed, inspected, and validated. How- 
ever, according to the diagramming hypothesis, spatial cognitive artefacts are 
multi-recruiting systems, and therefore also the actions performed are crucial 
for reasoning. Kirsh and Maglio (1994) have famously proposed to distinguish 
between pragmatic and epistemic actions: actions of the first kind aim to bring 
the agent closer to his or her physical goal, while actions of the second kind 
"use [the] world to improve cognition,’ i.e., they are “physical actions that make 
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mental computation easier" (Kirsh-Maglio 1994: 513). An epistemic action is 
performed outside on the physical objects that are available, and it is precisely the 
performance of this action that enhances our inferential capacities. The concept 
of epistemic action can be extended to the use of signs in mathematics. As De 
Cruz and De Smedt have recently proposed, mathematical symbols “enable us to 
perform mathematical operations that we would not be able to do in the mind 
alone, they are epistemic actions" (De Cruz-De Smedt 2013: 4). Of course, such a 
view is not epistemologically innocuous, since it assumes that mathematical signs 
are intimately linked to the concepts they represent and vice versa. 

Recently, together with Silvia De Toffoli, we have considered the case of a 
practice of mathematics where concrete manipulations and transformations are 
performed on the space of the representations: the practice of proof in topology, 
in particular in knot theory and low dimensional topology (De Toffoli-Giardino 
2014; 2015)? In our interpretation, knot diagrams are dynamic tools: in perceiv- 
ing a diagram; one has to see the possible moves that can be applied to them. For 
this reason, experts have developed a specific form of enhanced manipulative 
imagination, which allows them to draw inferences from knot diagrams by im- 
agining, and in some cases actually performing, epistemic actions on them. We 
argued that the meaning of a knot diagram is not pre-defined before the defini- 
tion of its context of use: it is only when the mathematicians fix the mathematical 
space in which the particular diagram is embedded and as a consequence choose 
which manipulations are allowed that the knot diagram becomes meaningful. 
This indeterminacy of meaning is precisely the feature that makes knot diagrams 
a space for experimentation, where different actions and consequently different 
possible interpretations can be tested. For this reason, knot diagrams are a good 
notation, because they represent mathematical concepts but at the same time have 
inferential power: a notation is "good" when it not only facilitates calculation but 
also prompts new ideas and induces new developments. Also the actual practice 
of proving in low-dimensional topology involves a kind of reasoning that cannot 
be reduced to formal statements without a loss of intuition: the representations 
that are commonly used in low-dimensional topology are heterogeneous, i.e. nei- 
ther entirely propositional nor entirely visual (the word/image dichotomy does 


not apply). 


2 More recently and along the same line of thought, we have analysed the proof of 
"Alexanders Theorem,” which allows connecting knots to topological braids (De 
Toffoli-Giardino 2016). 
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Manipulative imagination is shared by experts: it is the kind of reasoning that 
one has to master to become a practitioner. Moreover, the manipulations allowed 
on the representations as well as the representations themselves are epistemo- 
logically relevant, since they are integral parts both of the reasoning and of the 
justification provided: the representations give a material form to the transfor- 
mations (and in this sense they embody them), thus allowing experts performing 
epistemic actions (and in particular drawing inferences) on them. These actions 
are controlled by the shared practice: the set of legitimate transformations is lim- 
ited and determined by the context. Differently from gestures, diagrams are not 
idiosyncratic but part of a solid and stable practice. 


5. Open Problems 


To sum up, according to the diagramming hypothesis, spatial cognitive artefacts 
act as multi-recruiting systems. Despite not being material, gestures show that 
spatial and motor elements might help comprehension. Moreover, it has been 
shown that the way the notation is perceived influences comprehension and that 
experts in topology are able to envision (physical) transformations on the dia- 
grams having conceptual consequences. 

If diagramming really exists, then two questions can be formulated in relation 
to the general topic of this collection. The first question is for people working in 
education: would it be better to replace the reference to visual learning with that 
of (moderately) embodied learning? The second question is for the developers: 
what happens (or maybe what has already happened) when diagramming meets 
the new technologies? For example, should touch screen technologies be designed 
in accordance to a more serious reflection about the role of space and action in 
reasoning? This is matter (I hope) of further research. 
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Daniel L. Golden 


Visual Management of Time 


1. The Use of Time 


There is a striking contradiction between time as one of the most fundamental 
constituents of human existence, and as one of our most abstract concepts ever. 
While - as we can learn from inquiries made by Kristóf Nyíri (2006, 2007, 2016) - 
the sense of time is deeply embedded in our bodily subsistence from heartbeats 
to motoric gestures, this kinesthetic-biological background cannot give an ex- 
haustive account of time functioning as a social institution. The importance of 
the latter was realized by several theoreticians of modern society from the early 
20' century. According to Georg Simmel (1903), metropolitan life presupposes 
the precise coordination of actions via the harmonization of clocks. Max Weber 
(1922) suggested that modern bureaucracy is developing a so-called technocratic 
thinking through presenting itself as a machine-like entity yielding to ever better 
efficiency. Lewis Mumford (1934) envisioned the transformation of organic time 
into mechanical time in order to put social life under control. In general, mod- 
ernization will make indispensable reliable time calculating systems which can 
be accessed through uniform ways for the whole community at any point in time. 

Considering the long history of time measuring devices we can see that they all 
make use of certain natural-physical phenomena. However, the sun moving, water 
or sand flowing, electrons emitting microwaves, etc. are in themselves insufficient 
to turn time into something calculable. They need to convey their outcomes in a 
visible (or sometimes audible) way for human comprehension. Most measurement 
tools apply a kind of visual translation, i.e. projecting the passing of the abstract 
time into the factual space; casting a shadow on a display with a calibration, or 
installing a hand which will point at a certain section of the visually designed 
surface. In fact, sundials, clockworks, time lines, calendars and time tables all build 
upon visual components in order to make the abstraction conceivable, communi- 
cable, and operable for the human mind. We can even call this the “domestication 
of natural time;' as we may get the impression that we gain the power even to 
manipulate it by those artificial means. 
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2. Time Management and the Concepts of Time 


The main driving force behind the requirements on timing, tracking, and syn- 
chronizing human activities was, of course, industrialization, together with free 
competition. In that framework consumption of time had to be optimized in the 
same way as of any other material resource in order to benefit most from pro- 
duction procedures. Frederick W. Taylor (1911/1967) turned that efficiency issue 
into a scientific problem, making careful research and meticulous experiments 
with factory workers standing behind the assembly lines. Taylorism became the 
trademark for the idea that any human activity can be reorganized by identifying 
the distinct units of it and rationalizing the sequences of their realization. 

Since then time economy became one of the basic domains for management 
studies. As we can learn from a popular book on time management (Johns 2003), 
the very point to start from is the insight that "time isnt like the Brazilian rain 
forest: it is irreplaceable”. Time in itself may be endless, “but for each one of us the 
supply is undoubtedly limited” (Johns 2003: 5). That said, what we shall aim at is 
to take the control over the amounts of time standing at our disposal. “Manage 
your time or it will manage you,’ we are told. 

It is suggested that there are basically two ways of reacting to increasing duties 
and tasks. Either we simply elongate our working week: going to work early, stay- 
ing there late, taking work home, and working at weekends, or we start to manage 
time much more effectively and productively. The proper use of time is interpreted 
here as “adding value”. Conducive moves will include everything what brings us 
closer to a meaningful action: planning, exploring, thinking, making decisions; 
while wasting time will mean ‘spending it without added value, i.e. not being en- 
gaged in anything reasonable. Efficiency, then, will be formulated as maximizing 
the proportion of useful events to the time used. The manager’s task should be no 
longer fighting against unexpected threats to his or her company, but pursuing as 
many additional values in a given interval as it is possible. 

This also means that time management can be best defined as the ability of 
managing ourselves in order to produce the maximum activity within a certain 
period of time. So, arguably, it is about nothing else than “self-management, the 
demand for endurance and devotion in working consciously for carefully chosen 
goals or aims. It will consist of monitoring, evaluating and restructuring our cus- 
toms in time usage to improve inefficiencies. While managing public time served 
for the coordination among actions of different members of a society, here we are 
facing the claim for something similar, but on the individual's level, where distinct 
activities shall find their optimal order in a personal time frame. This would pro- 
duce something like a private time, which seems to make an important shift in 
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perspectives. Going one step further, we can say that the chasing of a competitive 
advantage in using time may change the concept of it from the “objective” to the 
"subjective" It almost seems to have a dual nature: either we can think about it as 
something built of rigid and unchangeable units, or we may think that there are 
certain holes in it which can be fulfilled by additional contents. 

At this point it seems to be advisable to take a look at the presuppositions about 
the nature of time behind time management. A first question is whether we shall 
think about time as linear or cyclical? Shall we say with Heraclitus that “one can 
never step into the same river; i.e. the flow of time is unstoppable and it stands 
above any human intervention, or rather share the idea revived from its ancient 
roots by Nietzsche about the “eternal recurrence, telling us that within the infinite 
realm of time the same patterns will be necessary repeated again and again. 

Probably to get time manageable, we have to assign to both of these aspects. 
Any planning for the future based on records of the past will have sense only if 
we think that certain situations will somehow return. But we should also believe 
that events are not determined forever, so that we will be in the position of mak- 
ing some improvements. 

Another question is in what sense we shall take time as a constituent of our 
world? Newton's absolute time, for instance, is linear, completely homogeneous 
and linked to mechanical movements, so that it can be split up into measurable 
units. It is a natural phenomenon entirely inhuman as it obeys natural laws in- 
dependently of human efforts made for measuring it. This mathematical-physical 
concept of time can be contested by psychological approaches. Bergson, for in- 
stance, contrasted this scientific notion of time with a metaphysical one called 
real duration. The latter cannot be split up mechanically into smaller parts as the 
former, and it can be experienced only through the meaningful actions of the 
individual. It will be more about quality than quantity, as "[...] the positive time 
manager will say: It isn't the hours you put in, its what you put into the hours 
which determines whether you're effective or not" (Johns 2003: 16). 

We can make our understanding even more complex if we consider the rela- 
tivistic challenge presented by Einstein, where activities with different intensity 
would make differences in the flow of time, thus resulting in incommensurable 
durations, relative to the personal frame of reference of the observer. On the other 
hand, from the perspective of Heidegger' existential analysis, authenticity of life 
depends on the proper use of our time. Against the ordinary concept of linear 
and infinite time going back to Aristotle, he insists, time is definitely finite, and 
we shall live our lives having that in mind, grasping all opportunities for giving 
significance to it. While the lifespan of the human being cannot be stretched over 
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its biological or medical limits, at the same time it can be seemingly infinitely 
widened inwards by acquiring more and more sense for it. 


3. Visualizing Tools and Understanding Time 


Management issues linked to the better use of our temporal resources are gener- 
ally about the improper occurrence of certain events - too many distractions in 
the forms of incoming phone calls or face-to-face interruptions, too little delega- 
tion of time consuming tasks to subordinates, etc. The results of these are mas- 
sive overloads of work in a given period. To avoid that, the good manager will 
make plans as to how to use his or her time more effectively. Data can be exam- 
ined from different angles: value-added analysis opposes maintenance and crisis 
prevention to performance improvement and changing management; task-scale 
analysis investigates whose expectations are coming to fruition, so that there are 
boss-imposed, system-imposed, subordinate-imposed, customer-imposed, and 
self-imposed uses of time; finally time-scale analysis makes distinctions among 
specific purposes such as administration time, communication time, operations 
time, supervision time, wasted time, and executive time. Based on those successful 
time management schemes, they must include a realistic estimating of the time 
necessary for a certain activity, while progress reports give feedback on how much 
the initial idea measured up to the time units actually utilized. The worst thing to 
be experienced in this respect is time-pressure, when the planned activity won't 
fit into the timeframe opened for it. In other words, there is a clash between our 
personal commitment to accomplishing a task and the impersonal flow of time. 

All these, once again, are presented through various visual-spatial depictions. 
For example, a deadline signed in a calendar gives the impression of a finite spatial 
area which should be filled densely with purposeful actions. By visualizing, we 
construct a common, external understanding on the top of our personal, internal 
experiences of time. We shall note here that the whole procedure seems to be highly 
conventional, since an abstract concept is represented by symbolic visuals, which 
will gain their concrete meaning only from usage, i.e. the manipulation of time 
made possible precisely by them. The visualization of time relations is actually 
built up in three steps. The first one is spatial metaphorization, the second is visu- 
alization of the spatial metaphor, which means the transformation of the abstract 
temporal relations into factual spatial relations. The third step already consists of 
the actions realized following the morals drawn from previous records: filling up 
empty spaces, reducing density, changing sequential order, etc. 

One of the most common tools is the daily time schedule in a form of a clock, 
where each hour is dedicated to a distinct activity (W1). Time tables are also 
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widespread for the same reasons: they show life put into logical order, under 
conscious control. Even the timeline can be regarded as a sequence of events with 
time stamps presenting how much one succeeded in managing his or her life time 
(W2). An unusual tool is the chronodex, or hyperdex, or spiraldex (W3), which 
gives the possibility of managing multitask-work by coloring time periods used 
for distinct activities. 

Besides these static representations, recent ICT developments put some dy- 
namic ones into everyday use as well. By utilizing the possibilities of moving pic- 
ture these are able to give the feeling of time passing as well. Think of the sidebar 
showing our actual position within the consumption of a certain media piece, or 
the download status bar transmitting the information about the state of perfection 
of the process going on. Both are making an effect on our sense of time by linking 
spatial proportions to temporal distributions in a dynamic way. 

Based on these insights a theoretical framework for the visual interpretation 
of time can be designed where the key terms will be proportion, resolution, and 
segmentation. 

We may find it quite embarrassing to hear that the secret of time management 
would be simply to “use all seconds in the day wisely" It is because we feel that the 
deliberate allocation of meaningful actions at this scaling is beyond the abilities of 
human beings. Instead, we will find different units of time and certain amounts of 
them proper for our diverse activities. We will want to count the time necessary 
for learning for the next school day in hours, preparing for an important exam in 
months, and the period of our lives dedicated to education in years. These meas- 
uring units of time are partly universal and objective, but in a sense also relative 
to the action in question. Resolution then would mean here, that one can actually 
zoom in and out over the images of time, so that you will receive different slices 
of its flow with different depths or perspectives. Management goals will be for- 
mulated in terms of proportions - which is a visually based concept coming from 
geometry - as e.g. “reduce the time spent on telephone calls by half”. Increasing 
efficiency will be executed through the redistribution of a timespan between use- 
ful and “unuseful” activities. While resolution defines the units, segmentation will 
give the scope or range of them to be seen together creating a temporal narrative, 
bringing into relief a certain amount of units that seem to be somehow linked 
together to form a meaningful section. Those will be the histories of a person, a 
family, or a nation. 

A unique example for that understanding of time would be the data visuali- 
zation made by Lev Manovich and Jeremy Douglass (W4) from all 4535 issues 
of Time magazine published between 1923 and summer 2009. The unit in this 
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representation without any surprise will be the week, while different periods of 20" 
century history can be identified by temporal patterns of different styles, printing 
techniques and other visuals of the front cover images. 


4. Conclusions 


Dare we say then that, at least in the context of human comprehension, time has 
a definitely visual nature? 

Philosophical considerations behind time management seem to give the pos- 
sibility of actually reconciling and somehow making use of all contradictory ideas 
concerning the features and functionalities of time. Visual representations seem 
not only linking together conceptually the physical and psychical understandings 
of it, but also merging them, giving the possibility to transform the abstract no- 
tion into something like a material resource consisting of practically controllable 
working units which can be reorganized at ones will. 

The visual-spatial external representations of our internal time experiences 
serve for mitigating, or civilizing the natural phenomenon. Throughout the cen- 
turies, dozens and hundreds of smart tools has been developed and constructed 
in order to give the possibility to seemingly manipulate time. In the place of the 
hardly conceivable flow of time, we put graphical symbolization of punctual and 
durational aspects, which can be easily perceived by the eye and the mind. 

In that way we end up with a notion of time linked to the presence of meaning- 
ful actions, which can give us the hope for utilizing the theoretic phenomenon 
pragmatically in the scope of our everyday life. 
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Javier E. Carreño 


Husserl on the Right Timing of Depictions 


1. Chronos and Kairos 


The founder of phenomenology, Edmund Husserl, might not come to mind 
amongst the foremost thinkers who are sensitive to the history and methods of 
rhetoric. And yet, at the crossroads of the phenomenological analyses of image- 
consciousness, time-consciousness, and aesthetic consciousness, one may be 
pleasantly surprised to find Husserl grappling with a basic rhetorical problem 
pertaining to so-called static images (such as representational paintings and busts 
in the manner of Albertian silhouettes) (Biceaga 2010: 83): how can such images, 
apparently ‘without a time, strike us as having a right’ timing? 

The claim that images are without time has had to reckon that there are mani- 
fold concrete ways in which plastic static images convey temporality to us. It is 
no accident, for example, that a photograph would present a past time; or that 
an impressionistic painting could convey movement; or that a sculpture could 
represent an event. Plastic images often reflect a temporality - be it real and his- 
torical, or else imaginary - which can be unfolded through acts of pure phantasy.! 
However, images convey a “perfect timing" or kairos whenever the tension between 
a depicted time-phase and the possible phantasy continuations is won over by 
the depicted time-phase on account of the maximal awareness it affords of its 
subject. While the chronos of an image makes the depicted time-phase simply a 
part of a greater whole, an image with a kairos gives the depicted time-phase as 


1 English translations of Husserl (in the Edmund Husserl Collected Works) have opted 
to render Husserl’s Phantasie into English as “phantasy,” amongst others to avoid two 
shortcomings with the English alternatives of “imagination” and “fantasy”. “Imagina- 

tion" irremediably links Phantasie with the having of *mental images" even though 

Husserl, as early as the Logische Untersuchungen, criticizes any and all psychologistic 

"picture theories" of consciousness (Husserl 2001: 125-127).“Fantasy” in turn triggers 

associations connected with the literary genre and with the imagining of objects with 

which we are not readily familiar as proximately actual or historical, while I can and 
often do phantasy with objects corresponding to those of a really possible perception 

(Husserl 2005: 2). While some commentators do translate Phantasie as "imagination" 

(Drummond 2008: 106), Husserl's own preference for “phantasy” would appear to be 

clear from his own entry to the term “fantasie” in André Lalande’s Vocabulaire tech- 

nique et critique de la philosophie (Lalandé 1988: 342). 
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a "whole; greater than (or at least preferable to) any of its imaginary temporal 
continuations (Rodrigo 2009: 180). As I will show, Husserl thus overcomes the 
binary categories of "static" and “proto-cinematic, which otherwise polarize the 
study of the temporality of plastic images (cf. Claass 2014: 10). 

Severalitems will need to be addressed shortly, beginning with the peculiar way 
Husserl's phenomenology understands images as representations of an “absent” 
time. Next, we will address how our awareness of time in images is different from 
our perception of time, before we come to terms with how an image might com- 
municate not just a time, but in fact a "right timing" 


2. The Consciousness of an Image Now" 


In the order of things, let us begin with how Husserl understands static images as 
presenting something temporal in the first place. For a phenomenologist, when- 
ever we confront an image, we are not just aware of a thing that happens to re- 
semble another, since things may perfectly resemble something, and yet not serve 
as images. Rather, when dealing with images, we are necessarily aware “at once” of 
more than one object. When beholding a portrait, we are aware of 1) a subject or 
‘motif? that appears in 2) the framed image that renders it. Together with Husserl 
we call the first the “image subject,’ and the second the “image object”. 

Portraits, then, entail a double objectivity. But since they appear on the basis of 
the sensuous surface of physical things, the phenomenologist further distinguishes 
between the *image object" and the 3) "physical image thing," such as the paint- 
stained poplar panel (Husserl 2005: 30). 

For the phenomenologist, this threefold distinction on the side of images (com- 
prising elements as disparate as the “real” canvas and the “phantasied” image sub- 
ject) would be altogether impossible without the involvement of a primitive form 
of conscious intentionality called “image-consciousness”. How image-conscious- 
ness differs from positing perception is seen in the fact that one who perceives 
either posits or seeks to posit the existence of what he perceives, whereas whoever 
beholds an image is not inclined to take the "image subject" as something actu- 
ally existing before oneself. From the standpoint of normal perception, the image, 
then, is a sort of "nullity" or illusion ("Schein"). Image-consciousness, however, 
contrasts with pure phantasy in that the “image subject" is intended mediately, 
i.e., in and through an image object - and yet not emptily, as it might be the case 
with signitive intentions. 

For Husserl, the realization that all depictions are, in a sense, “illusory, raises 
the important question of why and how images do not trick us. From the side of 
consciousness, image-consciousness connects at once a ‘perception (Perzeption) 
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of the image object with a ‘phantasy’ of the image subject. The involvement of 
phantasy here means, amongst other things, that no matter how “ready-made” 
an image may strike us, all images require the viewer's willful, conscious, and 
imaginative involvement. And from the side of the “image; Husserl realizes that 
depictions do not aim to pass for something actually perceived, as images offer an 
approximate rather than a perfect resemblance of their subjects. 

Moreover, image appearances are discontinuous with their perceptual sur- 
roundings since what appears in the image does not presently exist within the 
frame space. It is in this regard that Husserl describes the image as "the appearance 
of a not now in the now" (Husserl 2005: 47). The image appears in the midst of 
the field of perception, in the midst of all that is now present - but what appears 
in an image cannot be intended as something actually present. In contrast with 
its perceptual surroundings, the image is really a “nothing,” although this aware- 
ness of an images perceptual nullity does not prevent our regular dealings with 
images. On the contrary, when beholding Mona Lisa, we never quite perceive her 
as present, and she continues to appear in absentia. Thus, image-consciousness 
implicates a doubling of time, in the sense that what appears in the image is nec- 
essarily intended as belonging to a different temporal nexus from that of things 
that appear perceptually: “this exhibited something can never exhibit the now 
with which it conflicts; hence, it can only exhibit something else, something not 
present" (Husserl 2005: 47). 


3. The Temporal Halo of an Image Now 


At first blush, it would appear that Husserl draws an untenable conclusion with 
regards to images. Why would anybody call the appearing “not-now” in images 
something temporal? Is not temporality here precisely what is being denied? But 
for Husserl, a perceptual awareness of an abstract now-point is altogether impos- 
sible. Husserl's consideration of the temporality of images, then, coheres with a 
basic premise regarding our awareness of time. 

True to a time honored philosophical tradition, Husserl never defines tempo- 
rality. He goes as far as to say that we even lack the right words to speak about time. 
But just as Husserl addresses image objectivities by analyzing their corresponding 
intentionality, so does he also address temporal appearance by analyzing the con- 
sciousness to which duration and succession appear. To be sure, what falls under 
the purview of time-consciousness is not real or transcendent time, but the time 
of appearing. And this immanent appearing time "cannot be measured; there is 
no clock and no other chronometer for it. Here one can only say: now, before, and 
further before, changing or not changing in the duration, etc? (Husserl 1991: 339). 
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For the phenomenologist, the temporal awareness of something now or 'pre- 
sent (something purely temporal or else spatial-temporal) is always already three- 
fold in character. We are aware of an object as present because we experience it 
(a) in one of its phases as ‘now; (b) in one or more of its phases as ‘just-having-been 
now, and (c) still in other forthcoming phases as ‘not-yet-now’ But to be aware of 
anything temporal does not mean that consciousness has to constantly perform 
a trio of distinct temporal presentations, as if our awareness of time had to piece 
itself together. On the contrary, Husserl discovers that consciousness always al- 
ready manifests a temporal structuring, from "the boot, up; so to speak: we are 
internally and originally aware of the now phase’ of consciousness in “primordial 
impression" or “primordial sensation"; of the elapsed phases, in “retentions,” and 
of the forthcoming phases in “protentions”. 

Because of the three-fold structure of perceptual time-consciousness, we can 
never sensibly experience an object in a now-phase without being conscious of it 
in those phases that are strictly “not now”. For the ‘now is irremediably “a relative 
concept and refers to a ‘past; just as ‘past’ refers to the now" (Husserl 1991: 68). The 
same holds in principle for an “image now, even if it is also a perceptual “not now”. 
As Brough puts it, the depicted now-moment "cannot be snatched cleanly from 
its context with all of its temporal references scrubbed away" (Brough 2000: 236). 

Still, the formal necessity of characterizing the “image now" as temporal does 
not yet answer the question of how a depictive image acquires a halo of past and 
future temporal phases. Whichever way one considers this problem, it does not 
appear to be the case that one can simply complete the “imaged now" by intui- 
tively phantasizing a temporal halo for it. For by phantasizing, the Mona Lisa into 
phases, in addition to the imaged Mona Lisa ‘now, one still does not experience a 
continuous flow. When looking at the Mona Lisa, the only phase that ‘appears’ is 
the same Mona Lisa phase time and again: it never flows into retention as a no- 
longer ‘now’ phase. As Husserl remarks, “the modes of appearance are firmly shut 
off, no matter how they may run over into continuations by means of phantasy" 
(Husserl 2005: 537). Moreover, and unlike the perceptual awareness of time, there 
is no determinacy of earlier or later Mona Lisa phases: whether she appears the 
moment her smile no longer broadens, or whether she appears right before her 
smile broadens, cannot in principle be decided. And even if one were to say that 
the depicted now "always already" represents temporality; however emptily, the 
problem remains that the time-phase of the image subject “is ‘presented’ as de- 
tached, and does not abide in time, and is not really an enduring phase" (Husserl 
2005: 537). 
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One conclusion to be drawn here is that the formal determinations of image- 
consciousness and of time-consciousness which made it necessary to speak of 
an image temporality do not yet suffice to grasp it. For what these formal deter- 
minations emphasize is precisely the fact that the temporality of images does not 
compare to any perceived or purely phantasied duration. If there is time in images, 
it is certainly not a linear or sequential reconstruction of perceptual time. Thus, 
when Husserl says that “in the ordinary static image, which depicts by means of an 
unchanging image object, a movement might appear" (Husserl 2005: 489), it is clear 
that the latter apparition does not happen by an imposition of intuitive phantasy. 

And yet, could one not claim that it is in this transition or passageway between 
phenomena and the possibility to phantasy along that an image time opens up to 
us - as a duration that cannot flow in a succession of phases, but cascades from 
image into phantasy daydreaming? Is this not what we mean by "almost seeing 
what is about to happen" or almost "seeing what comes from happening" without 
losing sight of the image now? Is it not precisely in the contracting interstice 
between a perennial now and an evanescent phantasy temporality that we begin 
to suspect time on the side of the image since the image, as it were, has begun to 
re-organize my awareness of its time? 


4. Aesthetics of Kairos and Nonintuitive Phantasy 


In the final part of this paper, I would like to propose that the awareness of the 
"right timing" of an image is a temporal awareness that an image triggers by inten- 
sifying the awareness of the depicted subject in a particular time-phase. And Hus- 
serl understands this particular intensification of the awareness of the object in a 
singular phase takes place, amongst others, in the context of aesthetic experience. 

Husserl's comments on aesthetics are on the whole deeply influenced by the 
Kantian thesis of the disinterestedness of the judgment of taste (Husserl 2005: 
145). And Husserl takes up this aesthetic disinterestedness in any case as a matter 
of abandoning the existential, natural attitude, so as to become attentive to aes- 
thetic forms (Husserl 2004: 134). Whenever depictions are involved in aesthetic 
experience, however, we derive pleasure not only from how the image object ren- 
ders the image subject, but also from how we become aware of the image subject 
as a depicted objectivity (Husserl 2005: 390). Concretely speaking, when I con- 
template an artistic depiction I am moved, on one level, by a “maximum stock of 
sensuous moments and their particular combination" (Husserl 2005: 145). On 
another level, I am moved by “the clear awakening of the consciousness of the 
object" (Husserl 2005: 145). This consciousness of the depicted subject, even if 
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not positing its existence, nonetheless co-excites to a degree the awareness of an 
objects function or purpose. 

It is safe to say that for Husserl, an images aesthetic satisfaction is more a 
matter of expressing than of impressing, and that aesthetic pleasure increases the 
more clearly recognizable the image subject appears - e.g., in a characteristic 
position - and the more keenly aware one is of what is happening to the depicted 
subject in the image world. In the example of looking at an ancient sculpture of 
an athlete, Husserl is struck by how nothing appears to be random or indiffer- 
ent: “every nerve, every muscle" seems “attuned to action" (Husserl 2005: 146). 
We become aware not just of a thing, but more importantly, of the momentary 
tension between its “doing and suffering" And “[t]hat; says Husserl, “would be a 
beautiful aesthetic object: A pugilist or discus thrower who simultaneously has a 
stomachache" (Husserl 2005: 146). 

So at first blush Husserl seems to merely suggest that from out of a possible 
series of objective temporal and spatial phases, the artist selects the one that is 
ostensibly most expressive. The viewer, in turn, contemplates the image in the 
awareness of its maximal expressiveness compared to other perceived or freely 
imagined objective phases. This contemplation of a subject in the manner of its 
representation is not, per se, an accomplishment of intuitive phantasy. 

But Husserl's own aesthetic contemplation of the pugilist, and particularly of 
the athletes unapparent inner struggles, rather reveals a deep imaginative en- 
gagement with the image world other than by phantasy continuations. It is clear 
that the viewer who experiences such things before the image has entered into a 
fictionalizing attitude that attentively responds to what is portrayed? When the 
observer takes on this phantasy “fictionalizing attitude; the appropriate timing 
of an image can dawn upon her as a temporalizing experience. And in the case of 
a "perfect timing of images,’ the viewer will be drawn towards the “image now" 
phase in its completeness to a degree that can even disengage further phantasy 
continuations. 

Allow me to make clear the meaning of my previous statement by referring 
to Sigmund Freud's famous commentary on Michelangelos Moses. As it is well 
known, Freud disagrees with commentators who take the Moses as appearing 
either at a moment of great anger or “on the point of leaping up from its seat and 
rushing away to create a disturbance" (Freud 1997: 220). Freud comments that 


2 As Husserl remarks, “art is the realm of phantasy that has been given form, of intuitive 
phantasy, but also, in part, of non-intuitive [unanschaulicher] phantasy" (Husserl 2005: 
514). On non-intuitive perceptual phantasy see Carrefio (2013). 
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at some point this, too, was his expectation, but he was disillusioned by the fact 
that in repeatedly visiting the statue of Moses at San Pietro in Vincoli, in Rome, 
he never had the impression that Moses was about to break into movement: "this 
Moses would remain sitting like this in his wrath forever" (Freud 1997: 221). 
The sculpture seemed to convey no particular movement or duration. But when 
Freud focuses on the way that the right hand of the Moses holds a lock of the 
beard, suggesting a retreating motion, he then completes *in imagination [...] 
the scene of which this movement, established by the evidence of the beard, is a 
part" (Freud 1997: 224). More precisely, Freud takes the Moses to appear at the 
end of the movement and point of completion: "what we see before us is not the 
inception of a violent action but the remains of a movement that has already taken 
place" (Freud 1997: 229). 

Regardless of whether Freud's interpretation is persuasive, it seems to me to 
illustrate how the “right timing" of a depictive image operates. Clearly, Michael- 
angelos Moses conveys a potent and vivid awareness of the subject in his doing 
and suffering. But one might fail to see the volume and point of expressiveness 
altogether by simply and intuitively fantasizing subsequent Moses phases. Having 
entered into the appropriate “fictionalizing attitude; the viewer might experience 
his temporal awareness of the image time undergoing a subtle re-organization, 
e.g., seeing the Moses in a now-phase as the culmination (and not as a beginning) 
of an event in phantasy time. That other temporal reorganizations are possible is 
already clear from Husserl's own example of the pugilist appearing like in media 
res. But the fact that some temporal re-organizations are more suitable than others 
is a matter settled by how the subject is rendered in the image now - and this is 
the difference that having a kairos ultimately makes. An image with a kairos gives 
what it represents as the fruit of a temporal unfolding to a subject that receives it 
as the seed of a unique aesthetic temporality unfolding in her. 
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VISUAL RHETORIC, ICONOGRAPHY 


Petra Aczél 


Rediscovering the Visual in Rhetorical Tradition: 
Persuasion as Visionary in Suasory Discourse 


The history of culture is in part the story of a pro- 
tracted struggle for dominance between pictorial and 
linguistic signs [...] Among the most interesting and 
complex versions of this struggle is what might be 
called the relationship of subversion, in which lan- 
guage or imagery looks into its own heart and finds 
lurking there its opposite number. 


(Mitchell 1986: 43) 


Given the definition of imagery and language as an 
array of relationships, it might be easy to conclude 
that language and imagery are essentially the same. 


(Fleckenstein 2002: 13) 


1. Introduction 


In recent years the struggle Mitchell points to has been tamed and transformed 
into a common academic interest blooming in accordance with the ubiquity of 
visual information in mediatized human communication. “The growth of schol- 
arly interest in visuality marks a cultural reality: that images have become a pre- 
dominant means of transmitting information in the 20th century and may be even 
more so in the 21st,’ Scott Heller emphasizes (1996: A8). Thus, there seems to be no 
more need to fiercely fight for the rights of the pictorial in human cognition and 
communication. Without risking suspicion from academia, one can easily state 
that the visual plays a dominant role in sensing-cognizing the world, in construct- 
ing and concerting meanings, in human coexistence and communication. The 
prevalence of images has apparently won over the scepticism of science towards 
the non-verbal and thus we can claim that no thinking, learning and speaking is 
conceivable without the pictorial-visual taken into account. 

Nevertheless, rhetoric, a faculty that has long been identified as organically 
verbal still owes a lot to the rediscovery of the visual. Although a noticeable para- 
digm of visual rhetoric (Helmer-Hill 2004) has been built upon the assumption 
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that the lexicon of rhetoric is applicable to the pictorial, one may still doubt if this 
is the main visual potential the discipline of persuasive speech has. Rhetoric is at 
hand when the source of persuasion in pictures (structure, visual proofs, visual 
tropes) is to be explained; however, discussions of the visual within the rhetorical, 
and the visual drive of rhetorical force, stay disperse and remain non-mainstream. 

The present chapter is one that endeavours to highlight rhetoric as visual (and 
not visual as rhetorical). Sixth in a line of discussing the visual capacity of rhe- 
torical communication this paper focuses on persuasion as visionary in suasory 
discourse. Debated as it is, persuasion is at the heart of rhetorical practice. Though 
it has been “one of the great continuing mysteries of rhetoric and related discours- 
es" (O'Keefe 2001: 575), we can state that persuasion manifests the capacity of 
communication to attract attention, move minds, evoke emotions, alter attitudes, 
facilitate actions, transform people and change situations. Its power has widely 
been attributed to either the rational (logos) or the emotional (passions) proofs. 
This misleading duality has led to the political suspicion toward and academic 
dismay of the non-argumentative rhetorical speech and the overestimation of 
cognitive thinking and speaking. 

With a well-supported audacity we shall claim that behind rhetorical persua- 
sion there is a non-abstract, sensual communicative existence to which visual is 
the source of knowledge, experience and expression. Founded in the culture of 
orality, rhetoric has an original connection to seeing. Rhetoric and the rhetorical 
style is persuasive because of its visionary - making audiences to see, to feel, to 
enact - potential that is rooted in the speaker's visual-sensual encounter with 
the world. 

As the extensive analysis of rhetorical treatises of two millennia cannot be 
aimed at here, I limit myself to bring up some of the core ideas and terms justify- 
ing this claim. The quest for the visual in rhetorical persuasion will be pursued 
without chronological rigour - rather, with an eagerness to identify intellectual 
nods in classical and modern rhetorical tradition that can further center critical 
contemplations. 

As part of a series dedicated to the topic, this present paper strives to high- 
light relevant elements of the rhetorical system after already having dwelt on ars 
memorativa (the semi-conventional, picture- and space-based system of remem- 
bering texts), phantasia (the inner sense of the speaker and the listener, that entails 
imagination, cogitation and memory), ingenium (the creative force in meeting, 
cognizing and expressing the world), enargeia (the energizing force that guide 
orators to create vivid descriptions and to make their audiences to picture what 
is said in order to persuade), ekphrasis (the rhetorical description that unfolds 
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before the audiences eyes) and acumen (the sharpness in speech that represents 
and triggers sensual and cognitive discovery). Following the path into the treasury 
of visual tools in the garden of rhetoric, the function of wonder (thaumazein), 
the connection between the verbal and visual and between the visionary and 
the persuasive-charismatic will be investigated. Nota bene, this path sometimes 
leads us to the margins of rhetorical tradition, a place where logic is replaced with 
energy, the concrete is preferred over the abstract, and the verbal blends with the 
visual. It is a place where great authors and grand efforts (like Vico or Condillac) 
are wasted because of the domineering canon. This is what can make this quest 
even more invigorating, and hopefully, inspiring. 


2. Honeycomb 


Rhetoric, in the most general sense, can be regarded as a form of mental or emotional 
energy imparted to a communication to affect a situation in the interest of the speaker. 
[...] So understood, rhetoric is a feature of all human communication [...]. Even when 
thought of as the theory and practice of public address in a literate society rhetoric is not 
solely a western phenomenon. The earliest known rhetorical handbook is The Instruc- 
tions of Ptahhotep, composed by an Egyptian official sometime before 2000 b.c.e.; it gives 
advice about how to speak and when to keep silent if brought before a judge or ruler. 
Some of what is said resembles precepts in the Old Testament, as in Psalm 16: “Pleasant 
speech increases persuasiveness [...] Pleasant words are like a honeycomb, sweetness to 
the soul and health to the body" (Kennedy 2007: 7). 


Rhetorical language is bound to times, places and personalities; it is situational 
and subjective. 


Working with images and metaphors, rhetoric “make[s] manifest,’ revealing relationships 
through sudden and ungrounded insight into the data, issues, and questions philosophy 
and science approach rationally. It supplies the inventive capacity rational language lacks, 
the "firsts" without which rational language cannot get under way. Rhetorical language 
therefore always has a priority "and provides that which deduction can never discover" 
(Grassi 2001: 97) - 


as Crusius writes (Crusius 2001: xiv). Where does this non-deductive sweetness 
and primacy of words stem? Explanations of natural sign-relations and imitation - 
suggesting that the word imitates (does not represent or describe) the world - offer 
an answer to this question, but not to the practice and the influence of the rhetor. 
How are the rhetorical attitudes, sensitivities and influences operated in order 
to create the non-abstract sensual experience, ‘amazement, in order to move the 
audience? The key to this may be the ‘wonder’ gained by experience and through 
speech. 
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3. The Amazing 


By nature, all men long to know. An indication is their delight in senses. For these, quite 
apart from their utility, are intrinsically delightful and that through the eye more than 
the others. For it is not only with a view to action but also when we have no intention to 
do anything that we choose, so to speak, sight rather than all the others. And the reason 
for this is that sight is the sense that especially produces cognition in us and reveals many 
distinguishing features of things (The Metaphysics, 980a) 


- as Aristotle posits in the famous introductory lines of The Metaphysics (980a). In 
her effort to base the sources of non-cognitive thinking, Hannah Arendt (1981: 58) 
corrects the first English sentence in the paragraph saying that literally translated 
it would rather read: “All men desire to see and to have seen”. Knowledge then 
emerges from seeing, from experiencing the world as it is given to the senses. 

There is then an immediacy of seeing and being shocked by the world, a sub- 
lime trauma, a deep fascination that brings truth with itself. This truth is gained 
from experience from the world commonly inhabited, from common sense. It may 
not be irrefutable but is definitely speakable. This is the truth that stands at the 
roots of philosophy, of rhetorical persuasion and this is the truth gifted through 
thaumazein, wondering. Wonder is the initial shock of seeing something not yet 
revealed. It is the shock that arises tension and awakens attention; it is what marks 
the human encounter with the world. Grassi considers wonder of primary impor- 
tance to the essence of philosophy and gives a brief explanation of how thauma 
(wonder) integrates seeing and learning: 


The grammarian and lexicographer Hesychius gives in his lexicon the following synonyms 
for thauma: ekplexis (shock); xenisma (estrangement); and for thaumazein: theasthai 
(to look) and manthanein (to learn, to understand). [...] The etymological connection 
established both in antiquity and in modern times between thaumazo and theaomai 
points to the area in which the interpretation of the term thaumazein is to be looked 
for: on the one hand in seeing; and on the other in the domain of ‘immediacy, which 
establishes the relationship between wonder" and'emerging vision, already present in the 
prephilosophical use of the term thaumazein. [...] Questions arise only when something 
demands clarification, because uncertainty would be intolerable. In other words, we must 
find ourselves in the realm of an originary tension for our 'at-tention to be awakened. 
That is why the estrangement referred to by Hesychius in his lexicon is related to shock 
(Grassi 1994: 5-6). 


The wondrous emerges from the connection of events that are not in causal rela- 
tion, but reveal an inherent, necessary affiliation. It occurs within the system of 
nature, and brings a surprising consequence with itself. The apparent coincidence, 
the correlation, the connection that is expressed in the thauma proves itself to be 
inevitable for the receiver. Mere chance which has no connection with preliminary 
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and upcoming events is not wondrous, it has only a short-term effect of surpris- 
ing us. True thaumaston rather puts us off our everyday experiences and thus 
awakens emotions. Surprise is swept off by these emotions and we come to the 
conclusion that ‘this must be the way it is’ (Simon 1999; Poulakos-Nathan 2012). 
Arendt comments: 


In other words, what sets men wondering is something familiar and yet normally invis- 
ible, and something men are forced to admire [...]. The wonder that is the starting point 
of thinking is neither puzzlement, nor surprise, nor perplexity; it is an admiring wonder. 
What we marvel at is confirmed and affirmed by admiration which breaks out into speech 
[...]. In short wonder has led to thinking in words; the experience of wonder at the in- 
visible manifest in the appearances has been appropriated by speech, which at the same 
time is strong enough to dispel the errors and illusions that our organs for the visible, 
eyes and ears, are subject to unless thinking comes to their help (Arendt 1981: 143-144). 


Wonder sets up a cognitive chain that brings pleasure, passion and learning with 
it. Aristotle specifies the role of wonder among the aims of genres of speech in 
his Rhetoric. 


And to learn and to admire are usually pleasurable; for in admiration there is desire, so the 
admirable is desirable, and in learning there is the achievement of what is in accordance 
with nature. [...] Since to learn and to admire is pleasurable, other things also are neces- 
sarily pleasurable, such as, for example, a work of imitation, as in painting and sculpture 
and poetry, and anything that is well imitated, even if the object of imitation is not in itself 
pleasant; for the pleasure [of art] does not consist in the object portrayed; rather there is 
a [pleasurable] reasoning [in the mind of the spectator] that “this” is “that,” so one learns 
what is involved [in artistic representation] (On Rhetoric, 1371b). 


The immediacy of wonder, its energizing (epistemological) force to discover 
the unrevealed and the urge to speak about it is what makes rhetorical speech 
"touching, “moving” and memorable. The classical orator had to have a general 
competency to apply the accumulated wisdom of the common culture to the par- 
ticular case to move his hearers’ minds and engage their passions (Halloran 1994: 
331-332). The speaker acted in a known world where common sense prevailed 
over specialized knowledge and where the influence of the speech stemmed not 
from the actual newness of the information but from the act and expression of 
wonder with which a new connection between parts of the known could be shown. 

Thauma and admiration, shock and discovery, fascination and learning have 
not failed to serve as the way the speaker can create a situational climate for a 
persuasive speech. That is, a rhetorical act, which - prior to rational argumenta- 
tion - utilizes and displays the meeting of the verbal and the visual. 
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4. Visual and Verbal 


We might be able to disconnect image from language. We do this every night in our 
dreams. However, without language, we cannot do anything with that image except ex- 
perience it. Imagery lives in the moment and ties us to that moment. To be tugged out 
of that moment, to be known as anything other than life as it is lived, we need language. 
Similarly, the process of naming, the meaningfulness of language, is predicated on the 
existence of imagery. Language that is disconnected from imagery loses its meaning 
(Fleckenstein 2004: 15). 


The verbal and the visual thus are bound in meaningful expression, in rhetorical 
zooming on the situational and cultural at the same time. They are in kinship: in- 
separable and inevitable to invigorate the communicative situation. Nevertheless, 
there is a significant difference between language pairing or framing, recreating 
or governing the pictorial. 

For the classical and renaissance-humanist period, textual vividness and verbal 
persuasion was embedded into the concerted dynamics of phantasia (imagina- 
tion) and memory. Francis Bacon conceived of rhetoric as dependent on imagery 
and reassured that images are more memorable than words. For him, rhetoric's 
responsibility was 


to second the judgments of the reasoning faculty by working on the imagination. If rheto- 
ric is capable of seconding good and true judgment, then it cannot all be misrepresenta- 
tive. A part of rhetorics power, and indeed purpose, says Bacon, is to make the remote 
goods and natures that pure reason perceives appear to the auditor less distant, and thus 
it tries to overcome the more short sighted affections. Rhetoric, when supporting reason, 
knocks at the doors of the imagination [...] (Derrin 2013: 9). 


Bacon defined rhetoric as "subservient to the imagination as Logic is to the un- 
derstanding; and the Duty and Office of Rhetoric, if it be deeply looked into, is no 
other than to apply and recommend the dictates of reason to imagination in order 
to excite the appetite and will" (The Advancement of Learning Book IV, XVIII. 2.). 

From the elements of elocution imitation and description are the best to dem- 
onstrate how humanist rhetorical practice translated the visual into the verbal. 
Imitation was the method with which visions would be encapsulated and imagina- 
tion could be triggered within the schemata of description. Rhetorical descriptions 
intertwined the visual and the verbal just as it is elaborated by Henry Peacham’s 
vivid paragraph (1593/1954): 


Descriptio is a generall name of many and sundry kindes of descriptions, and a descrip- 
tion is when the Orator by a diligent gatherin together of circumstances, and by a fit and 
naturall application of them, doth expresse and set forth a thing so plainly and lively, that 
it seemeth rather painted in tables, then declared with words, and the mind of the hearer 
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therby so drawen to an earnest and stedfast contemplation of the thing described, that 
he rather thinketh he seeth it then heareth it. 


Growing interest in textual description inspired by Pseudo Longinus On the Sub- 
lime (around 100 AD) marked French and English belletristic rhetoric of the 18th 
century. Authors of the age favoured description as an important mode to imitate 
and capture the visible. Étienne Bonnot, Abbe de Condillac as a pedagogue, phi- 
losopher and rhetorician in his Lart décrire (1775, Of the Art of Writing, see the 
compilation of his Philosophical Writings 1982, 1987) 


explained the differences between the visual and verbal in this way: The visual world 
is holistic and is seen instantaneously as a picture. Verbal language is linear, occurring 
sequentially in units over time. Language decomposes holistic reality, allowing writers to 
convey what is really seen out there in the world into the mind, where we can once again 
recompose it to represent the holistic world. It also analyzes that reality by breaking it 
into bits. For Condillac and others in French belles lettres, the most expressive text is one 
that tries to re-create this all at onceness - this powerful tableau effect of prelinguistic, 
visual thought. [...] Thus, the keys to the later process of translation from visual imagery 
to written text were memory and imagination, closely linked (Hobbs 2002a: 38-39, see 
also Hobbs 2002b: 111). 


For the late humanist of the 18th century, Gianbattista Vico - who named Bacon 
as his main influence - speaking, language, history and social systems all started 
with the immediate and emotional experiencing of the world, that is, wonder 
which involved vision (and the senses). Human experience was apprehended 
by the power of imagination. Ingenium, ingenuity (Vico 1982: 69—70), the basic 
process to see and connect experiences - the capacity to invent, perceive relevant 
similarities, to make parts fit into the whole - was taught in the study of rhetoric. 
Thus language from its inception was metaphoric and imagistic and rhetoric as a 
mode of speech, primordial (Vico 1711-1741/1996; Grassi 1994). 

In the later era of modernity, however, language seemingly trapped the visual: 
imagery could gain legitimacy only through language-based frames. Principles of 
language were and are to be applied to visual operations that are, by their nature, 
different from the verbal. This is one of the reasons why the visual in rhetoric has 
been defined as an expressive feature instead of a generative force. Overarching 
studies of tropes and figures (neo-rhetoric, Dubois et al.: Rhétorique générale, 
1970/1981, see also Genette 1982) have limited and categorized the visual into 
style-formats and excluded it from ways of serious persuasion. The sharp distinc- 
tion between the emotional and the rational eliminated the archaic storming of 
the visual and verbal and cut off sensual appeals from the branch of argumenta- 
tive ones. Persuasive speech has been conceived of in terms of attitude, source, 
message, receiver and context factors, elaboration (O'Keefe 2002). Imagery as a 
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persuasive force was almost exclusively paired with the operations of metaphor 
and the notions of ‘visionary speech’ has been reserved for cases to which the 
terminology of persuasion could not be applied. 


5. Visionary and Persuasive 


What one may miss from contemporary rhetorical theory she will easily find in 
leadership studies where studies that succeed to identify applicable tools and ways 
to the formation of great, charismatic leaders are of true significance. For the sake 
of the present discussion charisma of the leader (Weber 1947; Simonton 1988) can 
be considered as a complex of abilities (and a joint perception) that captivates and 
moves receivers to act in accordance with a vision the speaker holds. 

House and Shamir (1993) examined eight theories of charismatic, visionary, 
and transformational leadership in order to clarify an overarching theory of cha- 
risma. Only one of 11 behavioural dimensions was represented in all eight theo- 
ries: visionary behaviour, that is, the articulation of “an ideological goal [...], that 
emphasizes fundamental values such as beauty, order, honesty, dignity, and human 
rights" (House-Shamir 1993: 97; Emrich et al. 2001: 527). In terms of visual and 
visionary rhetoric this articulation is what turns out to be decisive. Visionary rhet- 
oric is a discourse aimed to challenge the future and generate change persuasively. 
With its frame (expectations, norms, knowledge)-breaking and frame-realigning 
methods, visionary speeches paint the world and the future with words with lush, 
imagery-laden language. Persuasive as they are, they require elaboration; that 
elaboration occurs in terms of mental simulation of the situation being described 
by the content (Fauconnier 1994; Coulson-Oakley 2006). 

Vision content research has investigated the effects of imagery-based versus 
concept-based contents. Assumptions have held that image-based (concrete, 
emotional) content tends to evoke emotional, while concept-based content tends 
to evoke cognitive (hot or cold systems, see Metcalfe-Mischel 1999) responses 
from receivers respectively [...]. Researches on the relation between charismatic 
leadership and imagistic speech have mostly framed their methods on the basis 
of either Martindales Regressive Imagery Dictionary (1975), a content analysis 
coding scheme designed to measure primordial (associative, concrete) versus 
conceptual thinking (abstract, logical), or the Paivio, Yuille, Madigan noun pool 
(1968) or the Toronto Word Pool. All of these databases entail counts, lists and 
item value ratings that exhibit imagery- versus concept- and the concrete- versus 
abstract-based words. According to Emrich et al. (2001: 530) "the essential differ- 
ence between these two types of words resides in the extent to which each arouses 
a sensory experience in the minds of listeners. Image-based words more easily 
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evoke sensory experiences, whereas concept-based words appeal more strongly 
to listeners' logical interpretations" 

The findings of studies investigating the correlation between successful, charis- 
matic (presidential) leadership and the use of imagery (for example T have a dream’ 
instead 'I have an idea’) have consistently demonstrated that there is a significant 
positive relationship between the skillful use of imagery and leaders ability to per- 
suade people to accept and enact their visions, to be perceived and rated charismatic 
(Maranell 1970; Murray-Blessing 1994; Emrich et al. 2001; Naidoo-Lord 2008). 
Moreover, case studies (Willner 1984) and qualitative research that tested the ef- 
fect of metaphor on presidential/leader charisma (Mio-Riggio-Levin- Reese 2005) 
further justified that speeches by leaders perceived as charismatic have a higher 
amount of metaphor density as opposed to non-charismatic ones. Consequently, 
charismatic leaders use metaphors as a rhetorical tool to inspire and motivate fol- 
lowers (Shamir 1995; Mio-Riggio-Levin- Reese 2005). These findings support the 
research of metaphors and metaphorical messages as persuasive tools. As meta- 
phorical thinking may engage substantial image-based processes (Zaltman- Coulter 
1995) metaphors can constitute intense (Hamilton-Stewart 1993) or vivid (Nisbett- 
Ross 1980) language which can arouse greater effect on the audience and lead 
to more persuasion (Siltanen 1981). Metaphorical messages are likely to produce 
greater attitude changes relative to their literal counterparts (Sopory-Dillard 2012). 

As Emrich et al. assumed (2001: 529) "leaders who use words that evoke pic- 
tures, sounds, smells, tastes, and other sensations tap more directly into followers 
life experiences than do leaders who use words that appeal solely to followers’ 
intellects. By engaging followers' senses, not only their minds, leaders make their 
messages more immediate, real, and appealing to followers" The usage of image- 
based rhetoric results in a vivid performance which has the capacity to grasp 
listeners' attention, facilitate their comprehension, evoke emotions and incite 
elaboration and motivate their memory. 

Rhetoric that is crafted to be image-based, image-evoking, concrete is easier 
to process, to relate to and to interpret emotionally (Miller-Marks 1997) and 
to elaborate than its non-imagery counterpart. Vivid speakers seem and sound 
more active and dynamic and their audiences feel more inclined to judge them 
as competent and visionary. 

As for stimulating memory processes: imagery produces superior memory for 
verbal material (Kieras 1978; Paivio 1986). 


When a follower hears, comprehends, and is motivated to store in memory a leader's 
message, an image-based message will be stored in more “places” and in richer detail than 
a comparable concept-based message. Therefore, when it is time to act, followers will have 
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greater success retrieving a leader’s image-based than a concept-based message and will 
have on hand a richer, more detailed and, hence, potentially more instructive guide for 
action (Emrich et al. 2001: 533). 


In short, research findings confirmed that messages of leaders/speakers are more 
influential when they are high, rather than low, in imagery; the speaker's ability to 
convey images in words plays a key role in visionary behaviour and that effects of 
imagery in speech positively correlates with persuasive communication and the 
perceptions of speakers as charismatic. 


6. Epilogue in Lieu of Conclusions 


The initial shock of experiencing what is unrevealed in the world, co-existence of 
the verbal and visual in thinking and speaking, the imitation of vision in words, 
and visionary oratory all belong to the tradition of rhetoric. However, the study 
of textual products and logical procedures has apparently overcome the con- 
sideration of visual processes in rhetorical speeches, leaving the faculty and its 
pedagogy without two of its most discerning characteristics: visual thinking and 
the sensualizing of language. Thauma, phantasia, ingenium, enargeia, charisma - 
these constitute the vocabulary of visionary rhetoric, a mode of speech the us- 
age of which could re-penetrate contemporary rhetorical theory - the lexicon of 
structure, logic, argumentation, style - in order to see clearer the function and 
influence of vision and imagery in persuasive communication. Sparkling ideas 
of theoretical forerunners and the strong body of research evidence support any 
scholarly ambitions which aim to dive for more visualin the rhetorical. The pre- 
sent chapter meant to be a humble contribution to further quests of the brave ones. 
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Timothy Barney 
The Rhetorical Lives of (Cold War) Maps 


The September 17", 1951, issue of Time magazine featured a peculiar and striking 
image over a two-page spread - a map of the sprawling Soviet Union. The map 
reveals a network of red circles, shaded areas, and pink hammer-and-sickle icons 
dotted all over the topography of a stark gray and white Soviet landscape, each 
indicating the location of “Gulag” system prison camps. The accompanying text in 
Time tells a story of the maps provocation of an incident between the U.S. and the 
Soviet Union at the 1951 San Francisco conference to inaugurate a Japanese peace 
treaty. Here the “Gulag-Slavery, Inc? map became a cartographic weapon when 
Missouris Congressman O.K. Armstrong walked up to Soviet Deputy Minister 
of Foreign Affairs, Andrei Gromyko, and asked him if he wanted to see a map of 
Russia. "Td be delighted, said Gromyko. Unfolding the map, Armstrong helpfully 
explained: "It happens to contain an accurate portrayal of every slave labor camp 
in the Soviet Union”. Gromyko blinked at the map, mumbled “No comment,’ and 
handed it to an aide who tossed it into the aisle. Indeed, below the imposing map 
are before/after-style photos of the"incident" - on theleft, we see Republican Rep. 
Armstrong unfolding the map before a sitting Gromyko; on the right, we see a 
stone-faced Gromyko staring ahead, as the map sits beside him on the floor of 
the conference room (News in Pictures 1951: 28-29). 

Of course, the Armstrong-Gromyko exchange can be added to a long list of 
the minor anecdotes in the history of chilly, Cold War diplomatic relations. Yet, a 
deeper exploration of this map reveals a compelling case about both the strategic 
and ideological functions of mapping. Before the map became a kind of diplo- 
matic prank in the hands of Congressman Armstrong, it began as a collaboration 
in a global labor research project between the AFL-CIO and the United Nations 
Economic and Social Council, authored by a Russian emigrant ghostwriting jour- 
nalist, underwritten by the CIA, and publicized internationally by The Voice of 
America radio. The many uses and appropriations of the piece has led to its cita- 
tion as “one of the most widely circulated pieces of anti-Communist literature" 
(Young 1958: 601). 

In this era, maps were constantly appropriated, debated, revised, and re- 
appropriated. Cold War maps lived; they were active and malleable documents. 
Such a seemingly, bi-polar, universal, and fixed conflict as the Cold War required 
immense work to maintain an image of fixity. Maps, thus, had to continually 
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reproduce and maintain the essential artifice of the conflict. Bruno Latour has 
written of the concept of “immutable mobiles, in which a visual image of scientific 
data is frequently seen as a fixed and finished product, hence immutable, yet at the 
same time an image that is constantly moving and reproducible for a multitude 
of contexts (Latour 1990: 26). A map has an age-old power, then: to appear as an 
unimpeachable representation of the world, while its easy usability makes for a re- 
markable flexibility in what it can offer its users (Raffestin 2000: 9). The hardened 
lines between the U.S. and the Soviet Union (and by extension Americas allies 
and satellite adversaries in its so-called "spheres of influence" across the globe) 
may appear immovable and essential on Cold War maps; however, the hardening 
of these lines only comes from the maps ability to draw and be drawn into the 
active construction of the Cold War. 

These active constructions can be traced through a specific, critical approach 
to analyzing cartography. A map possesses what I would call a "rhetorical life" In 
other words, a map has a particular lifespan in which it exists as a communica- 
tive practice, as it works through the intersections of public and private spaces, 
institutional and popular contexts, and artistic and scientific modes of collection, 
synthesis, and expression. By noting the concept of a rhetorical life, though, I am 
not concerned with some kind of defined origin point or "end of life" death mo- 
ment for a map. Such points are always debatable and shifting, depending upon 
context - and therein lies the point: a map is never a finished product (Hartnett 
1998: 287-288). Rather, the notion of a maps "rhetorical life" merely points to how 
a map reflects and shapes its multitude of contexts, as it lives and functions as a 
usable, material document (see also Certeau 1984: 121). Finding the connections, 
say, between the production techniques of a map, and the ways in which that map 
is re-used and re-copied allows us to keep the business of cartography properly 
historicized and dynamic across wide expanses of time (Pickles 1992: 219-220). 
Cara Finnegan has written of the “eventfulness” of visual images, specifically pho- 
tographs, wherein the meaning-making of an image stems from the contexts of 
its production, the details of its composition, and the movement of that image 
through the complex contexts of its immediate reproduction, its circulation, and 
in the variety of responses from audiences (Finnegan 2010: 251). For the lives of 
Cold War maps, we can similarly trace the residues of a map as it moves through 
the culture, and how it assumes a diversity of particular roles for its users. 

The concept of a rhetorical life emphasizes the engagement of a map with its 
immediate context, but also with other Cold War artifacts. Denis Wood and John 
Fels have argued that the map continually advertises itself to be taken authori- 
tatively, and that advertisement takes the form of a paramap. The paramap is a 
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construction that goes beyond the map itself and includes all of "the verbal and 
other productions that surround and extend" a maps presentation (dedications, 
inscriptions, epigraphs, prefaces, notes, illustrations) (Wood-Fels 2008: 8-9). In 
addition, the paramap includes all of the elements not just appended to the map, 
but circulating in the social space around the map (advertisements for the map, 
reviews, production information); for Wood and Fels, "ultimately it is the interac- 
tion between map and paramap that propels the map into action" (Wood-Fels 
2008: xvi). What this approach seeks to prove is that a map is never just a map, 
but a confluence of social forces that constrains a culture’s sense of its relation- 
ship to, and in, the world. Maps are central, then, to a concept prevalent amongst 
geographers and historians, of a "geographic imagination" where cultures obtain 
and circulate geographic knowledge." 

The idea of the paramap can extend to how mapping is described and ac- 
counted for by its practitioners and circulators. Shawn Parry-Giles has emphasized 
the need to examine not only the public discourses of the Cold War, but also the 
need to evaluate and weigh the covert actions and motives of its powerful actors 
(Parry-Giles 2002: 183-186). How these agents, often behind-the-scenes, actually 
talk about and conceive of their roles and their messages reveal the very fluidity 
and the constructed nature of the Cold War, as well as what kinds of collaborations 
and contestations brought certain ideologies forward while relegating others to 
the background. Map producers and users wrote and spoke often about the role 
of space and how geopolitics positioned the United States in particular ways, and 
thus that “cartographic talk” is as important as the maps they accompanied. While 
the finished displays of Cold War maps often rested upon an aura of "truth" and 
objective detachment so common to scientific work of the era, the producers and 
users of maps showed a remarkable understanding of how maps could be molded 
to create very specific visions and advance complex arguments (Harley 2001: 37; 
Pickles 1992: 219). 

This kind of movement of a map through Cold War culture, as well as the ways 
in which cartography is contested and debated by its users, is borne out through 
examples like “Gulag-Slavery, Inc? Across an enlarged Russian Caucasus was a 
rash of red dots indicting what Soviet officials were denying in international me- 
dia. This AFL map is certainly important for how its visual codes and symbols 
politicize the space of the Soviet Union as a landscape of secrecy and oppression; 


1 Derek Gregory has provided a full theoretical treatment of this “geographic imagina- 
tion" concept (Gregory 1994). Another rich historical application of these notions can 
be found in Schulten 2001. 


86 Timothy Barney 


yet, adding to the maps display on the page is its provenance and its remarkable 
life as an active, evidentiary weapon. The Gulag map was a collaboration between 
popular journalists, the State Department, and an AFL looking to strengthen its 
anti-communist credentials. And the map arrived in a political culture rife with 
Holocaust memory and visuality as well as with the charged discourse of “slav- 
ery" against ideological foes. Lawmakers quickly adopted the map as an icon for 
hardline anti-communism, American teachers used the map to teach current 
affairs in classrooms, overseas labor unions circulated the map to their “brothers” 
to protest working conditions, and official Soviet reaction to the map (in charged 
diplomatic exchanges and even in seizures of it on the streets of Eastern Europe) 
brought out the hostility against Western propaganda. 

Other examples from the period offer intertextual support to the "life" of the 
Gulag map. Also in 1951, the American Geographical Society, through sponsor- 
ships from Army and Navy research grants as well as major pharmaceutical com- 
panies, embarked ambitiously on a project to map current knowledge of diseases 
and health epidemics such as polio, malaria, yellow fever, even starvation. The 
resulting Atlas of Disease produced an influential series of innovative, detailed 
maps between 1950 and 1955 that showed a world filled with parasitical invaders.’ 
Particularly during a tumultuous period of decolonization, the Atlas of Disease 
visualized the so-called “three worlds" that theorists and practitioners of develop- 
ment and modernization were using to “bring up" the “diseased” sub-equatorial 
nations. But, again, more than mere visualization, the lives of the Atlas of Disease 
maps showed the active movement of cartography into Cold War spaces: used by 
corporations such as Pfizer to develop international markets where its drugs could 
yield the best profits, brought into the Army to study the viral encephalitis that 
U.S. troops in Korea were suffering from, re-drawn in Congress to support fund- 
ingand expansion of the Mutual Security Act, and used to study where "advisers" 
could safely tread in Vietnam. 

Despite their different aims, the Gulag map and the Atlas of Disease maps 
are united in the ways they fuse institutional and popular discourses together, 
and in the ways that their eventful rhetorical lives made them usable, material 
documents. Both also intersect with the immensity of Cold War state power in 
the United States as they reify the importance of spatial perception in defining 
American interests vis-à-vis the Soviet Union and the so-called rest of the world. 


2 These materials are collected in the Jacques May Papers Collection and the American 
Geographical Society Medical Geography Archives at the American Geographical So- 
ciety Library (AGSL), University of Wisconsin-Milwaukee. 
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The Gulag map served to edify the stark lines of the East/West dichotomies of the 
early post-World War II era, while the Atlas of Disease foreshadows the ways in 
which new North/South dichotomies would come to constrain the decolonizing 
Cold War landscape and Americas increasingly intervening hand. Such rhetorical 
lives even show the kind of important conversations that maps, in a sense, shared 
with other maps. At one point, for example, the producers of the Atlas of Disease 
consulted with the leaders of the American Federation of Labor and their Gulag 
map data to pinpoint where the Soviet government was holding its prisoners, in 
order to plan their own map of human starvation.? Even small connections like 
these create a tangible sense of a wide cartographic scope that encompassed the 
Cold War and the compelling ways that American officials and other prominent 
institutions were dependent on particular cartographic perceptions of the world. 

Cases like these affirm that cartography, and by extension, the production of 
Cold War space, was above all, a practice. The “production of space” is often a term 
that is invoked vaguely - an idea easier to theorize about in the abstract than it is 
to see in everyday interaction. And yet, as geographer Jouni Hakli notes, “cartog- 
raphy offers a productive momentum to political practices"; in other words, the 
relevance of maps is based on the “immutability in the relationships that maps 
establish between cartographic representation and the world of practice within 
which they emerge" (Hakli 2009: 28). 

Maps like the Gulag project, for instance, reveal what geographer Trevor Barnes 
and others have called the *mangle" of collaborations and competitions between 
the foreign policy institutions of the executive branch of the U.S. government, 
the defense apparatuses of the armed forces, private and independent organiza- 
tions such as the AFL, the popular journalism at outlets such as Time, and even 
supranational powers like the United Nations (Barnes 2008: 7). Common amongst 
these groups was the impulse to work out the spatial parameters of what exactly 
the Cold War was, and how it should be, or should have been, fought. And while 
the rhetorical presidencies of central figures such as Truman and Eisenhower 
remain vital to Cold War study, as does the critique of its famed architects like 
George Kennan and Walt Rostow, one of the best ways to trace Cold War space 
is to follow its mid-level bureaucrats, practitioners, and policymakers who were 
actively writing world space and circulating geographic visions (this approach is 
modeled in Farish 2010). 


3 Specifically this information is archivally drawn from: Letter From A. Larkin to Jacques 
May, 22 June 1953, Folder 1: Plates 8 and 9, Correspondence 1952-54, Box 3, Series 1: 
Professional Records, 1943-1960, Jacques May Papers, AGSL. 
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To take Bruno LaTour too far, though, is to see maps as actually immutable; 
rather, the perception of maps as immutable is what powers cartography. Maps 
are fundamentally insecure. 

Rob Kitchin and Martin Dodge express that a map is: 


[...] brought into the world and made to do work through practices such as recognizing, 
interpreting, translating, communicating, and so on. It does not re-present the world 
or make the world (by shaping how we think about the world); it is a co-constitutive 
production between inscription, individual and world; a production that is constantly in 
motion (Kitchin-Dodge 2007: 335). 


» 


Maps, then are "always mapping; attempting to appear representative, and this 
process is what makes maps so dynamic in Cold War culture (Kitchin-Dodge 
2007: 337). 

Thus, from the origins of particular Cold War maps and their techniques of 
production and data management into their appropriated usages and diverse 
interpretations by sometimes competing and sometimes collaborating Cold War 
institutions and audiences - the story of how the U.S. mapped itself and the world 
in the second half of the twentieth century is a vital story about the synthesis, the 
framing, and above all, the practice and the movement of Americas international 
power. For geographers Denis Wood and John Fels, to map is to claim that "this 
is there" - and America required images of strength and commitment in maps 
to legitimize its self-interest as commensurate with the interests of the rest of 
the world, and for those images to have productive (and inevitably contentious) 
lifespans across a wide array of contexts (Wood-Fels 2008: xvi). 
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Paintings and Illuminated Manuscripts 
as Sources of the History of Childhood: 
Conceptions of Childhood in the Renaissance 


1. Opening Remarks. Aims of the Research 


"The history of childhood" refers to a discipline, including Renaissance views 
on children, childrens lives, and child-rearing practices, as well as their environ- 
ments and surroundings changing over time (from past to present). Paintings and 
other visual documents from this time could help us interpret childhood and the 
world of children from their perspective. This article will introduce the aims of a 
study and doctoral thesis, and review the possible iconographical, semiotic, visual 
anthropologic and visual sociological picture analysis methods of pedagogical 
research. The goal of the thesis is to describe how the conceptions of childhood 
changed in a specific period during the 15th and 16th centuries. Why did we 
choose 1455-1517? It is important to understand how the inventions of printing 
and the Reformation affected the way of thinking about child-rearing practices. 
The doctoral thesis was published by Eótvós Publishing House in 2015, and will 
hopefully help other researchers to understand the problems parents faced in part 
of the Renaissance era. 
The goals of the research are the following: 


1. To introduce possible visual analysis methods for qualitative research meth- 
odology. 

2. To introduce new sources for history of childhood and education - such as 
old-prints (incunabuli), woodenblock-prints and illuminated manuscripts. 

3. To understand conceptions of childhood within a special era, specifically Late 
Renaissance narratives about childhood. 


Why did we consider part of the Late Renaissance (1455-1517) as a possible era 
of such research? We wished to understand how the inventions of printing and 
the Reformation affected the way of thinking about child-rearing practices. The 
importance of these decades in art history is also considered very high: painters 
such as Mantegna or Dürer used a special viewpont, analysed the human body, 
observed anatomy, applied the Golden Section, used new colors and techniques. 
In the Christian canon, the theories changed from Christ as a human to Christ as 
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a child. There is a gap in the secondary sources of history of childhood regarding 
the following theoretical works: Shahar (2000), Pollock (1983), Heywood (2001), 
Cunningham (2005) and Szabolcs (1995). Some of the secondary sources end 
the Renaissance era in 1500. We will examine some decades earlier than 1500 as 
a starting point of “modern” history. 


2. Theoretical Framework 


This is an interdisciplinary study, containing communication and visual studies, 
history of art and iconography, history of education, with history of childhood 
and sociology. There are however some more possibilities, for example psychology, 
demography, ethnography, and anthropology. 


2.1 Theoretical Issues on the History of Childhood 


According to Colin Heywood, there is a definition of childhood - it is an abstrac- 
tion, referring to a particular stage of life, which changes over time and varies 
between social and ethnic groups within any society. Historians wish to recreate 
the day-to-day experiences of children in the past. This is the social history of chil- 
dren (Heywood 2001). At the end of 1970 most historians agreed that the history 
of childhood was a history of progress, and that the conditions of children had 
improved over time. The first work of this paradigm - Centuries of Childhood - 
was from the French philosopher, Philippe Ariés. He represents this progress by 
comparing and contrasting the present to the past centuries. The other theoretical 
work about the history of childhood is Lloyd DeMause' work, called: The History 
of Childhood (DeMause 1974). The central tenet of this book is the psychogenetic 
interpretation of history; the subtitle of this work - The Evolution of Parent-Child 
Relationships as a Factor in History — represents this concept as well. DeMause 
periodised parent-child relations in six modes (Szabolcs 1995; Pukánszky 2001). 

The British historian Edward Shorter published his thesis Good Mothering is the 
Invention of the Modern, which shows us, for example, the practice of not sending 
children off to a wet-nurse, which had been common in the past. Ariés, DeMause 
and Shorter had one thing is common - they believed that there had been over 
time major changes in the attitudes and treatment of childhood. A new paradigm 
by Linda Pollock was published in Forgotten Children: Parent-Child Relations from 
1500-1900 (Pollock 1983). Pollock made a systematic study of diaries and autobi- 
ographies in Britain and North America concerning child-rearing between 1500 
and 1900. She pointed out in this research that lower class child-rearing practices 
did not differ fundamentally from upper-class practices (Cunningham 2005: 9). 
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Shahar disproved the previously popular thesis that medieval infant mortality 
rates caused the parents lack of love for their children, assumed to be less loving 
than modern parents. There were some different child-rearing practices, however; 
some elements are part of our views nowadays too. According to his research - 
which was published in his second book, Children in the Middle Ages - the child's 
world was deeply integrated to adult's lives (Shahar 2000). 

We must not compare present childhood conceptions to the past ones using 
the modern perspective. We have to accept the mentality of the time, as we must, 
for example, with medical practices of the specific era. Sociologists James and 
Prout (James-Prout 1997) published their theory about childhood as a social 
construction. The new paradigm is potentially fruitful for historians. If we ana- 
lyse paintings with iconographic methods, we can see children as social actors. 
Paintings could help us to assess the interpretations of childhood and the world 
of children. Hendrick pronounced the child as a social actor (Hendrick 2000) so 
I will use this term in my analysis. We should never compare children to adults, 
yet they are social actors too. 

To conclude this theoretical schema, we can say that the narrative of childhood 
can be seen in many different ways, such as our specific conception of child- 
hood. We will not, however, state an unequivocal global conception of childhood 
(Szabolcs 2004). 


2.2 Paintings and Photos as Sources of Interpreting Childhood 


Itis possible that paintings could influence child-rearing practices and theories of 
children and childhood. If paintings are considered a type of media, and media 
had similar roles in peoples lives as today, then paintings could have such effects 
on people's way of thinking. In order to observe this idea, we analysed over a hun- 
dred Italian, French and Dutch paintings, illuminated manuscripts and old-prints 
from fifteenth to sixteenth century. 

Flemish artworks were satirical representations of peasant lifestyle and every- 
day life. Dutch colors are vivid, and the technique is meticulous. Flemish painters 
observed every detail precisely. Italian painters, on the other hand, used their 
works to demonstrate their own education, knowledge of theological discourse 
and philosophy; they were proud of their virtuosity in technical issues, such as 
Andrea Mantegnas innovations on perspective. Mantegna became a master of 
realistic figure depiction too (Turner 2000: 281). 

The inventors of oil paintings were Flemish brothers: Hubert and Jan van Eyck. 
At both parts of the Low Countries you can see an intimate atmosphere in the 
pictures. We must note the reinvention of the female portrait tradition in the Mona 
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Lisa by Leonardo, which is the visual representation of the living soul, and which 
has entered every viewer since (Sperling 2003: 51). The art of Michelangelo and 
Raffael perform as the examples of intellectually complex puzzles for scholars. 

A lively exchange between north (Flemish masters) and south (Italian mas- 
ters) got under away. Rogier van der Weyden visited Rome in 1450; Antonello da 
Messina united Italian and Flemish traditions, since he studied in the Netherlands 
and later worked for the court in Naples. Late Gothic forms in paintings such as 
elongated figures, sculptural modelling and vibrant lively lines were dominant in 
both areas, e.g. Benozzo Gozzoli and Sandro Boticelli in Italy, Hugo van der Goes 
in the Netherlands. The display of Hugo van der Goes’s Portiniari Altarpiece in 
Florence in 1483 was a milestone (Turner 2000) (Figure 1). 


Figure 1: Portiniari Altar by Hugo van der Goes, Uffizi, Florence, oil on wood, (c. 1475), 
253 x 586 cm 


3. Introduction of the Research Methods and the Sources 


"Images are helpful for what they tell us about educational situations, breaking 
the prevailing silence regarding the specific character of educational and child 
rearing processes, they also seek to convey an educative message in themselves" 
(Depaepe 2000: 15). Kress and Leuween declared in their book Reading Images 
(Kress-Leuween 2006) that social relations can be encoded in images. It is often 
said that the producer and the viewer differ in a fundamental aspect: the producer 
is active, while the viewer is passive. The articulation and understanding of social 
meanings in images derives from "face-to-face" interaction; the spatial positions 
allocated to different kinds of social actors in the interaction (Kress-Leuween 
2006: 116). Pictures have the capacity to convey information that cannot be coded 
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in any other way (Nyíri 2009). Sources can be any kind of document within the 
presence of a human being: written words, photos, artefacts and oral testimonies. I 
analyze paintings, manuscripts, incunabulis (old-prints) and wooden-block prints, 
using qualitative analysis methods such as semiotics, iconography, visual anthro- 
pology and visual sociology. 

Iconography is originally a sub-discipline of art history, which concerns itself 
with the subject matter or meaning of works of art (Panofsky 1972: 3). Iconogra- 
phy as a research method derives from this branch of art history and other visual 
arts (Géczi 2010). Erwin Panofsky, who published his theory about image analy- 
sis and influenced iconographical studies for decades, declares the stages of the 
iconographical analysis for the history of art. This iconographical analysis is based 
on three phases of the reception of an image. The acts of interpretation are the 
pre-iconographical description, the iconographical analyses, and the iconographi- 
cal synthesis (deeper analyses). Iconographical analysis is dealing with images, 
instead of motifs (Panofsky 1972: 3-33). In order to understand the meaning of 
the painting for another discipline, such as history of childhood, we need to find 
another analysing process of images. 

Although this research is focusing on paintings, old-prints and woodenblock 
prints, it is very important to mention Mietzner' and Pilarczyk’s thesis about 
categorization and classification. Their theory is based on photo analysis; however, 
itis a handhold for the paintings too. Mietzner and Pilarczyk have analysed more 
than 10,000 educational photos so far. They understood the deeper meanings of 
images which represented educational interactions or child-rearing processes in 
wider contexts (Mietzner-Pilarczyk 2005). There is a visual analysing method 
invented by a French researcher called Bouteaud (1989), and this method focuses 
on the technical information of each picture. A serial visual anthropologic method 
invented by Collier (2010) could be fruitful for researchers, who need a compari- 
son method for pictures with similar topics. This paper is an introduction of a 
possible analysis method based on the methods mentioned above. 

The topics of the selection of the pictures is based on Heywoods' paradigm 
about the themes of the Renaissance conceptions of childhood: child-birth, 
the life of new-born babies, mortality (Heywood 2001). It is followed by one 
more topic which was absent from Heywood's paradigm: the games or toys of 
children. 
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4. Sample Picture from the Research! 


Figure 2: Andrea Mantegna, Madonna with Sleeping Child, 1465-70, Tempera on canvas, 
43 x 32 cm, Staatliche Museen, Berlin 


Classification (Figure 2) 


1. Date: circa 1465-70. 

2. Place: Italy, Mantua 

3. Authorship: Andrea Mantegna 
4. Use: It was an altarpiece. 


Mary looks extremely young in this painting. Their clothes could be similar to 
the gowns they wore in this decade. Jesus’ tight swaddling-clothes were typical of 
this time period. Jesus’ body looks babyish; however, his face looks much older 
(late adulthood). The goal of the painting was to show the virginity of Mary. 
Mary expresses fear and protection with the gesture of both hands. We can see 


1 We would now like to mention the most important museums and libraries where the 
research took place: The Bibliotheca Communale dell Archiginnasio, Bologna; The 
Biblioteque Denis-Diderot, Lyon; The Semmelweis Museum of Medical History, Bu- 
dapest; The Library of Congress, Washington DC; The Museum of Fine Arts, Budapest; 
Albertina, Wien. 
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love, tenderness and anxiety in her eyes. Since she cradles the sleeping baby, she 
is protecting him. Her brooding gaze suggests a presentiment of some kind. She 
will hold her son for the last time as Pieta, later. The tenderness of Madonna 
might catch our glimpse. We could wonder about the relation of mother and 
child. Whether the childhood mortality rate was high or not, mothers loved their 
children as much as they do nowadays. Child-rearing practices were based on 
love and harmony. 


5. Results of the Research 


Using qualitative analysis methods such as semiotics, iconography, visual anthro- 
pology and visual sociology, children can be seen as wondering, nosey, playful 
human beings in the Renaissance Era, between 1455-1517 in Europe. Using mi- 
crohistorical perspectives we can understand several more situations, and aspects 
of everyday life and mentality. 

The conclusions and tendencies are the following: 

The love of the mother towards their children contains the attitude of fear. 
The value of the life of the children is above the value of the mother's life. They 
baptised their newborns as early as possible. Children's games were as important 
then as they are today, or even more important. Breast-feeding is more important 
and more common regarding the pictures, than we expected. 

The most interesting topic is the swaddling-tight, which began disappearing 
from paintings in the 1480s. It would be interesting to examine these traditions 
with a wider basis of visual sources focusing on the Northern or Southern part 
of Europe. 

Regarding the analyzed pictures, the children received more attention than 
their mothers. For example, while we have no evidence of the bathing traditions 
of the mothers, we could find a wide range of pictures of bathing children. The 
representation of Death could be grotesque, fatal or ludicrous, because of the 
powerlessness regarding the high ratio of mortality. 

To look into the Renaissance paintings, manuscripts, old-prints and wooden- 
block prints - using my iconographic method, we could see conceptions of the 
childhood of the Renaissance era. However, children were much more vulnerable 
than today, they learned to live dealing with mortality. They baptised their new- 
borns as early as possible. Children's games were as important as today or even 
more important. Using microhistorical perspectives we explored several situations 
and aspects of everyday life and mentality. 
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ONLINE VISUALITY 


Krisztina Szabó 


Digital and Visual Literacy: The Role of 
Visuality in Contemporary Online Reading! 


1. Introduction and Background 


Discussing the notion of contemporary online reading in the new media age, it is 
clear that the shift from printed to online is not just a change of instruments or data 
media, but also text comprehension. In connection with the latter, we usually come 
up against the problem of visuality. The line between textuality and visuality seems 
to blur, their traditional hierarchical order is gradually disappearing, and the prob- 
lem of reading literacy and its surveys become more complicated. It is obvious that 
the enormous amount of visual elements which turn up in almost every online text 
have a significant role in the reading processes. But what is this "significant role"? 

In my paper, beginning with this question, I will focus on the role of visual 
elements in online texts. I will state that visual elements have at least an equal or 
even dominating role over text in the online reading processes. 

In the time of the so-called new media age, many questions are raised concern- 
ing the constantly changing way of reading, originating from the issue of the digi- 
tal devices that have come into use, that can easily substitute for printed books and 
newspapers. While there are debates and predictions about the future of books and 
reading itself, more and more attention is being turned to the nature of reading 
literacy (Ulin 2009; Fekete-Hegedüs- Kis 2010; Cull 2011; Rich 2008; Dougherty 
2011). Researchers have the assumption that new types of reading devices con- 
tain new types of texts that needs new types of reading skills and methodology 
(Smolin-Lawless 2003; Coiro-Dobler 2007; Walsh 2010; Murnane-Sawhill-Snow 
2012). The shift from printed to digital is so significant that it is better to narrow 
the focus and talk about digital literacy as a new field of understanding reading. 

However, "digital" is not the only essential feature of the issue, but also the on- 
line space as well, that lets us wander from one text to another throughout a web 


1 This ongoing research is conducted in the framework of Integral Argumentation Stu- 
dies, OTKA - K-109456 at the Doctoral School of Philosophy and History of Science, 
Budapest University of Technology and Economics. 

Special thanks go to János Tanács PhD, István Danka PhD and all colleagues at the 
Department of Philosophy and History of Science, Budapest University of Technology 
and Economics, who helped me with their professional advice during my research. 
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of links. The shift from printed to online is not just a change of instruments or data 
media (like the ones from papyrus to paper, scroll to newspaper and book, or book 
to e-book), but also a significant change of comprehending texts, hence a distinc- 
tion has to be made between digital (offline) and online reading. During online 
reading, we meet special and, in some ways, new types of text, a kind of visualized 
hypertext. The line between text and visuality, or text and pictures, seems to blur, 
and their traditional hierarchical order (in texts the written enjoys priority over 
pictures) is disappearing (Kress 2003; Youngs-Serafini 2011). Thus, in this paper 
I am focusing on the role of visuality in contemporary online reading. I state that 
visual elements, especially pictures, are neither just illustrations nor just explana- 
tory additional elements, nor secondary qualities beside texts, but they have at 
least an equal, or even dominating role, over text in the online reading process. 

In order to confirm my hypothesis, I will discuss the complex connection be- 
tween online and offline reading and visuality, showing the role of images in 
the reading process and focusing especially on online reading. My aim with this 
research in the long run is to help create and develop online reading literacy 
surveys of PISA (Programme for International Student Assessment), by making 
the methodological framework more adequate. In 2018, reading literacy will be 
the major domain of the surveying process, till then both the actual framework 
and terms should be updated.’ 


2. About the Complex Connection between 
Reading and Visuality 


Before turning to the role of visual elements in the online reading processes, we 
should examine the issue of offline reading, too. The whole topic of literacy tradi- 
tion, from picture reading to picture books, comic books, illustrated workbooks, 
etc., is so diversified and concerns such a wide range of scientific fields that it goes 
beyond the scope of this essay. The present focus is on the nature of text itself that 
originally has a sort of visuality. The “[...] name for a group of signs is text - a 
collection of signs which organized in a particular way to make meaning. The 
meanings made will depend on which signs are brought together, and how they 
are arranged in relation to one another” (Schirato- Webb 2004: 8). The fact that 
reading is to comprehend signs - which are visual elements with special charac- 
teristics such as font style, size and arrangement - means that the whole reading 
process is subordinated to visuality (Figure 1 and 2). 


2 For more details and critics about the PISA-subject see my previous articles: Szabó 
2014; 2015a. 
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Figure 1: A sample list of fonts installed with Microsoft Windows Vista and Windows 7 
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(source: W1) 


Figure 2: Example for font-arrangement 


warm chewy 
gingerbread man, 
made in some oven 
while lying in a pan. 
people are waiting 
to eat his hand 
why is it they will 
mostly nibble on his limbs? 
leaving him (if he could ) pondering, 
wondering just what he'd done to them? 
this punishment is a bit harsh it seems 
only just for giving them oh, 
such tasty dreams, 
children all begging 
they want to taste too, 
be sure there's enough 
if it's the last thing that you do. 
more are waiting cut them out fast, 


although we try I'm pretty sure 
they're not going to last. 


(source: W2) 
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Even so, normally we think on the contrary, and make a distinction between text 
built up by words, built up by letters and other additional visual elements (for e.g. 
pictures). We are proud to say that we are over the ages of picture-reading and we 
do not need any visual help for comprehending a text (see the practice of Euro- 
pean education starting from recognizing pictures [signs] and aiming to read long 
texts fluently; Youngs-Serafini 2011; Adamikné 2006; W4). In this sense visual 
elements only illustrate texts, and complete and explain the meaning of words, if 
necessary. If it is not, never mind: a well-written text is thought to be understood 
without any visual support. Thus, in traditional reading, a literacy survey’s text is 
at the centre, and readers should be able to separate the text (to be read as a task) 
from its context and comprehend it on its own sake. 

This process becomes much more problematic if we would like to survey the 
reading methods of picture books, workbooks or comics - in these cases we deal 
with multimodal texts. It means a triple signal system: written language/text, pic- 
ture/visual elements and a "third quality" (Youngs-Serafini 2011; Szabó 2015b), 
the latter connecting the two previous levels. In these cases visual elements give 
meaning and drive the reader' attention, so there is an interplay between texts and 
visual elements (Szabó 2015c). At this point, the clear distinction between text and 
context, text and visual elements fails, and the problem of reading literacy and its 
surveys become more complicated. Now, suffice to say that the role of visuality in 
reading literacy is quite important even in the case of offline texts. In the next sec- 
tion I will turn to online texts and the role of visuality in the online reading process. 


3. Online Reading and Visuality 


In online reading the online text itself is visual. But this implies there to be a 
different and more complex phenomenon compared to the case of printed texts. 
An online text is built up from characters (which we can also call signs) and 
“multiple communication modes" visual elements, for instance image, audio and 
video. They "are governed by distinct logics [which] change not only the deeper 
meaning of textual forms but also the structure of ideas, of conceptual arrange- 
ments, and of the structures of our knowledge" (Kress 2003: 16, in Weasenforth 
2006: 1). This statement underpins the necessity of my previous distinction be- 
tween digital and online reading: the latter means not just a medium-shift but 
also a text-comprehending issue. “The world told is a different world to the world 
shown" (Kress 2003: 1). Writing is for “to tell" while visual elements (for instance 
images) are for “to show” (Kress 2003). The main difference between them is that 
"[...] writing [...] is governed by the logic of time and by the logic of sequence 
and its elements in time, in temporally governed arrangements" (Kress 2003: 1). 
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Contrarily, "the organization of image is governed by the logic of space and by 
the logic of simultaneity of its visual/depicted elements in spatially organized ar- 
rangements" (Kress 2003: 1). However, I must disagree - even in the special case 
of printed picture books, workbooks and comics. Take the latter as an example: 
in comic books, pictures are also governed by the logic of time, they are in tem- 
porally governed arrangements whereas they are also governed by the logic of 
space. And the same phenomenon could be easily noticed vice versa. The issue 
is the same in the case of the online version of picture books, workbooks and 
comic books (Youngs-Serafini 2011). Take an average text on the Internet rather 
than these specific types of texts. The label "average" is problematic; there are 
debates on the question of what it means to be a "text" in the online space (Cull 
2011; Bolter 2001; Szabó 2015c; Dyson-Kipping 1998). This vagueness is rooted 
exactly in the nature of visuality that interweaves the online contents. An online 
text is more than a digitalized version of an offline text, because the online nature 
of it essentially modifies its reading, meaning and comprehension. Researchers 
call these “hypertexts,” which are “linked to each other with hyperlinks so we can 
easily switch and jump between them, like in a kind of eternal, never-ending and 
always refreshed text" (Szabó 2015c: 171). Hypertexts, also because of the online 
space, naturally "live together" with visual elements. This connection could be so 
complex that sometimes it is difficult to decide what is related to the main text, and 
what is just an additional illustrative or design element or a supporting icon of the 
digital device. This could be a problem for instance in online literacy surveys: if we 
do not have exact notions about the texts that are to be read, then we will easily 
conclude inappropriate results about readers skills and the reading process as well. 

However, this should not be too surprising: if the connection between an offline 
text and visuality is so strong and complex, then it should be at least the same in 
the case of online texts, too. It is vital to emphasize that the observation of online 
texts should start from the thought which discusses texts and visual elements as 
interplay and a sort of interlock. Thus, texts and visual elements in the online space 
are at least not subordinated but they supplement each other. As we will see in the 
next section, visual elements have a much stronger and inevitable role in online 
texts and online reading comprehension. 


4. The Special Role of Visual Elements in 
Contemporary Online Reading 


Researchers investigating the nature of online text comprehension regularly indi- 
cate the following observations. First, defining online text is problematic because 
of the strong presence of visuality. Second, visual elements significantly influence 
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and modify the meaning of a text, thus we should examine the mutual effects of 
texts and visual elements on each other in online reading processes (Szabó 2015c). 
Above, I have already shown that visual elements, both in the case of printed 
and online texts illustrate, complete and explain the main text - on the first level 
of comprehension. Furthermore, they give meaning to the texts and drive the 
reader's attention during the reading process. In short, there is interplay among 
the text and visual elements. Now, I claim that visual elements have at least an 
equal or even a dominant role over text in the online reading processes. Visual 
elements do not just support comprehension, but dominate or even replace online 
texts. "[R]eaders imagination is a matter of ordering elements in contrast to fill- 
ing traditional text with meaning. [...] readers do fill images with meaning also" 
(Weasenforth 2006: 27). Moreover, “images are plain full of meaning, whereas 
words wait to be filled" (Kress 2003: 3). Thus, “the conceptualization of textuality 
is changing as images seem to dominate text and as screen overtake paper [...]" 
and “writing becoming subordinated to the logic of the visual" (Kress 2003: 5). 
This is a cardinal change in comparison to traditional theories about printed texts, 
claiming the dominance of texts over visual elements. In this sense we could talk 
about the rediscovery of the visual. 

Itistime to reflect on the topic called visual literacy. Visual literacy is the "ability 
to decode, interpret, create, question, challenge and evaluate texts that commu- 
nicate with visual images as well as, or rather than, words. Visually literate people 
can read, interpret the purpose and the intended meaning, and evaluate the form, 
structure and features of the text. They can also use picture and word images in a 
creative and appropriate way to express meaning" (Carry n.a.: 13). This definition 
is based on a theory implying that “picture books, magazines, newspapers, adver- 
tisements and films create meaning through shape, line, colour, actions, eye paths 
and angles" (W3: 3). Thus, here again, the main issue is the role of visual elements 
embedded into some kinds of texts. The connection between text and visual is so 
strong that in some cases - e.g. in online reading - the text is subordinated to the 
visual. To be“[...] able to make sense of what we see in images and understanding 
how these pictures relate to the writing associated with them" (W3: 2) is the main 
issue of visual literacy - and online reading literacy, as well. 

There is continuity in the printed - digital - online reading triad and visuality 
has its own important, variant and intensifying role in every step of this path. 
Focusing on online reading, the special role of visual elements could be the fol- 
lowing (Figure 3). 
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Figure 3: The role of visual elements in online reading 
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Visual Elements 


in Online Reading Sve meaning 
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Dominate or even replace text 
Support (text) comprehension 


Web = Visual elements + text as 
context 


(source: image created by the author) 


With this we have returned to the question of what it means to be “text” in the online 
space. With taking the notion of visual text we get an even more complex picture, 
where we should take the following features into consideration as well (Figure 4). 


Figure 4: The complexity of visual texts 


Over Time 
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Disciplines 
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(source: Carry n. a.: 8) 


According to the above, the answer would be: online text is like the web itself. It 
is a sort of content composed from text (characters, words, sentences) and visual 
elements (pictures, images, graphics, etc.). With this definition, the already fuzzy 
concept of online text comprehension may become even more complex, but it 
could serve as a step forward to get a better understanding on online reading 
literacy. 
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5. Conclusion 


In my paper I focused on the special role of visuality in the online reading process. 
I claimed that visual elements are neither just illustrations, nor just explanatory 
additional elements nor secondary qualities beside texts, but they have at least an 
equal or even a dominating role over text in online reading processes. First, to sup- 
port my hypothesis, I separated the notions of printed, digital and online reading 
from each other and then I examined the connection between offline reading and 
visuality in the traditional sense. Second, I discussed the role of visual elements in 
the case of printed text and online texts as well as visual texts, and referred briefly 
to some special cases, too. I demonstrated on three levels that visual elements have 
three important roles in online texts and - contrary to traditional views - texts 
do not dominate the visual anymore. Moreover, visuality has gained dominance 
over text in the online space, and it is better to talk about texts as webs or contents 
which built up from characters and visual elements. 

This shift in the hierarchy of texts and visual elements is so significant that it 
basically modifies and influences online reading and text comprehension - thus 
we should take it into account in contemporary reading literacy research and 
surveys as well. 
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W1 = A sample list of fonts installed with Microsoft Windows Vista and Win- 
dows 7. http://ptgmedia.pearsoncmg.com/images/chap3_9780789749550/ 
elementLinks/03fig23_alt.jpg (Figure 1). 

W2 = Example for font-arrangement. http://mrfletcher.weebly.com/shape-poems. 
html (Figure 2). 

W3 = Every Picture Tells a Story. Accessing Visual Text. https://dei.eduone.net.au/ 
projectresources/media/ Accessing VisualTextFinal.pdf. 

WA = Módszertani kézikónyv a magyar nyelv tanításához az 1. osztályban. 2009. 
http://www.szmpsz.sk/szmpsz/hir/2009/0902_abeceskonyv/metodika.pdf. 


Gergely Havasmezói 


Images in the Hungarian Online News 


1. Visual Elements in the New Media 


The traditional, illustrative role of images in journalism is changing. “Digital media 
environments usually demand from the journalist to combine and mix text, images, 
video, audio and other visual graphics [...] states Fondevila-Gascón et al. (2013: 1). 
This fits into the much debated thesis of the “pictorial turn”: that images (again) 
take more important roles in our communication. "People first think in images, 
only later in abstract words,” states Kristóf Nyíri (2000). “The ratio of the images 
is increasing on the internet and in the printed press (e.g. in the tabloid press) too. 
Pictorial communication is turning quotidian,” writes Ágnes Veszelszki (2008). 

All these permit online organs to use visual elements more boldly and in new 
roles. The online audience got used to images appearing as self-standing conten- 
tual elements - that is, images carry decodable meaning independently of the text, 
and they contribute to the content of the article equally with the text. Infographics, 
which speeds up information processing by compression (Veszelszki 2014) is a 
good example. 

However, not all media use these opportunities. Traditionally, the media used 
mainly photographs (Fondevila-Gascón et al. 2013: 52), and although online edi- 
tors tend to like technical novelties, their journalistic attitude and practices often 
lag behind (Steensen 2011). 

In this study we analysed the image usage of the most visited Hungarian online 
journals, divided into two groups: "traditional" media (those that have a print ver- 
sion, their online versions thus being of secondary importance) and “new” media 
(those exclusively online). Our theses are: 1) there are significantly more visual 
elements in the articles of the “new” media; 2) significantly more visual elements 
have self-standing contentual value in the ^new" media and they appear in roles 
that does not exist in the "traditional" media at all. 


2. Methods 


The eight most visited Hungarian general-interest news portals were selected 
based on publicly audited data. 168 Óra Online, Magyar Nemzet Online, Nép- 
szabadság Online and Válasz.hu belongs to the “traditional” media group; !!444!!!, 
Index, Origo and VS.hu belong to the “new” media group. We saved the papers 


114 Gergely Havasmezói 


own articles that appeared on the homepage at the time of the sampling (5-6pm) 
and had a publishing date of that day (between 20 and 23 July 2015). 

We decided to use every visual element that was edited purposefully into the 
article. The reason for this is that boundaries are blurred between objects and 
images, both in appearance and functionality: a "gif image" is essentially a small 
video; a real video may be started by clicking on a static cover frame; maps are 
moveable and zoomable; a Facebook insert may contain comments and other ele- 
ments; charts are often interactive. Simple photos can be interactive, too: clicking 
on them may open a full screen image or a photo gallery. 


3. Results 
3.1 Frequency of Visual Elements 


One hundred thirty-four articles appeared in the "traditional" media, and one 
hundred seventy-two in the“new” media. VS.hu leads with 6.21 images per article 
on average; Magyar Nemzet Online finishes the list at 0.38 per article. “Traditional” 
papers publish on average 0.60 visual elements in an article; “new” media publish 
2.32, almost four times more (for more data see Figure 1). If we count images 
against the total character numbers of all articles, "traditional" media publish one 
image in 4,555 characters, and “new” media publish one in 976. 


Figure 1: Visual elements per article. The leading place of VS is somewhat difficult: a single 
article, which we will analyze later, contributes with 78 visual elements. However, it is 
reasonable to include it since the paper frequently publishes articles of this kind 
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It is rare in the online media to use lead images (images appearing in the “lead,” 
illustrating the whole article). The usage of homepage images differs widely, too 
(the term meaning here that the articles title and lead appears on the homepage 
illustrated by an image). Some decisions seem logical: for example, Origos low 
number of homepage images could be a decision to ease the congestion on the 
homepage because the paper publishes much more articles on it than the others. 
Some seem a little strange: for example, MNO uses a lot of homepage images 
but in the articles it uses the least visual elements by far, meaning that the paper 
took the effort to find an image for most articles, it just did not include them in 
the articles themselves. In general, we can say that there are no common image 
policies among the papers. 


3.2 Functions of Visual Elements 


There was only one paper where the traditional illustrative use of images did not 
prevail: 444.hu (3996). At the other end of the list there are Válasz.hu and 168 Óra, 
having only illustrative images (for more data see Figure 2). 


Figure 2: Distribution of image functions among articles that have at least one visual 
element 


Figure 2: Distribution of image functions 
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Among those articles of the “traditional” media that apply at least one image, 87% 
uses them only in an illustrative role. The number is 73% for the“new” media. The 
difference between the two groups is minor but consistent through all image roles 
(articles written about an image: 2% and 7%, respectively; articles about videos: 
696 and 796; articles about a Facebook or Twitter insert: 096 and 196). 

There are some articles where images and text are equally important: "the text 
loses effect without the picture, and the picture also loses effect without the text" 
(Veszelszki 2012: 104). 

Among the articles that use at least one image, 696 in the "traditional" media 
and 10% in the“new” media, behave this way. In some articles the visual elements 
appear in a new role: they are in interaction with the text, forming the message 
of the article together, achieving a goal that separately none of them could. The 
following analysis of two of them highlights their methods. 


Figure 3: Screenshot detail of the site where the article "These corporations rule the 
country" appears. The cat picture is a “gif” short video 
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(source: Hungarian newsportal 444.hu, WI; screenshot taken by the author) 


The article titled These corporations rule the country (W1) writes about a list of the 
greatest corporations of Hungary. The text briefly discusses some factual oddi- 
ties of the list, however it is given a new and much stronger message by the lead 
(and homepage) “gif” image of a grotesque fat dancing cat (Figure 3). Memes of 
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cats are usually presented for a humorous goal, therefore the image raises a light- 
minded feeling; moreover, the English term “fat cat,’ referring to the corporations, 
is recognizable for many Hungarian readers, too. The cognitive approach of the 
text and the intuitive approach of the image together present the message that the 
ranking of the corporations is not to be taken too seriously. This message is not 
present in either the text or the image separately. 


Figure 4: Screenshot detail of the article "Zsolt Németh might have sent the woman back to 
the kitchen with a corny joke" 
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(source: Hungarian newsportal 444.hu, W2; screenshot taken by the author) 


The article titled Zsolt Németh might have sent the woman back to the kitchen with 
a corny joke (W2) writes about a supposedly embarrassing utterance of Zsolt 
Németh, a Hungarian politician. Ihe text is only one paragraph long; there is, 
however, a lead photo above the paragraph: one that shows Németh sitting on the 
right side of the prime minister Viktor Orbán at an event that is known as being 
significant for the PM (Figure 4). The image, meaning "Németh is really close to 
the PM; thus shames the prime minister, himself not even present in this par- 
ticular piece of news. Again, the message of the article is decodable only by the 
interaction of image and text. 
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We risk the opinion that this role of visual elements demands a greater than 
average decoding ability from the reader, but they have potentially the greatest 
impact on him, too - creating the impression of thinking along the same lines 
with the author, discovering hidden meanings, the feeling of a common mischief. 

Among the analysed sites, it is VS that uses the benefits of online visuality to the 
greatest extent. The layout of the site is different from the standard news portal: 
images are dominant on the homepage and on the article pages (always applied as 
lead images). It is more important, however, to take a look at the column “Mega”. 


Figure 5: Screenshots of the article “If you came to Hungary". Up left: a scrollable photo 
gallery. Up right: a text block. Down left: a chart. Down right: a video insert 


Doses roca 


(source: Hungarian newsportal vs.hu, W3; screenshots taken by the author) 


The column uses advanced web programming to create interactive, multimedia 
articles in which images, videos and texts are equally important (Figure 5). Jour- 
nalists, photo and video professionals, design specialists and programmers work 
together on them. At the time of our sampling a new “Mega? article appeared on 
the site: “If you came to Hungary" (W3). 

The prevalence of visual elements is clear. One can “scroll” the article and get 
a new window of content, however the basic layout of the window is static. Most 
content is based on an image or a video, and they occupy the whole area of the 
screen: there are no spatially separate blocks; all content is treated the same. Text, 
when it appears, usually hovers over the visual elements. A timeline shows where 
the reader is in the article and provides control over it. 
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The article uses the interaction of the text and the visual elements heavily. Tex- 
tual blocks, describing facts, are followed by photos and videos setting the mood 
and showing personal faces and stories. Charts help with processing the informa- 
tion presented in the text. The timeline, the act of scrolling, the few buttons that 
point to hidden features, and the interactive photo galleries enable the reader to 
actively discover the article, as opposed to a passive recipient role. 


3.3 Comparison with Fondevila-Gascón's Study 


Fondevila-Gascón and his group studied the image usage of four news portals of 
international fame (Fondevila-Gascön et al. 2013). All would belong to the“tradi- 
tional" group of our study. They counted only photographs, so in this comparison 
we will use similarly restricted data. 

The 2013 study found that the journals published 44.2 images a day on aver- 
age. The same data in our “traditional” group is 18.25, in our “new” media group 
69.75, meaning that the four leading Hungarian newspapers in the "traditional" 
group publish merely 41.2996 of the amount in the foreign papers, while this per- 
centage at our “new” media is 157.8096. The 2013 study writes that photographs 
far outnumbered videos and other "graphical complements": the same is true for 
both of our groups. 

The illustrative usage of images dominates all four papers of Fondevila- 
Gascóns study (even the lowest ratio, that of Corriere della Sierra, shows a fivefold 
advantage for illustrative images). The same is present at the Hungarian papers, 
too, with the exception of !!444!!!. 


4. Conclusions 


We studied the frequency and functions of the visual elements at the most visited 
Hungarian online newspapers. We divided the papers into two groups: “traditional” 
(those having a primary print version with an online version secondary to this) 
and “new” (those exclusively online). We did not limit the study to simple pictures 
because the boundaries between the types of visual elements are indeed blurred. 

Our first thesis was that there are significantly more visual elements in the ar- 
ticles of the “new” media. The thesis gained confirmation." Traditional" media use 
0.60 visual elements in an article, “new” media use 2.32, almost four times as much. 
Curiously, no “traditional” paper reached one image per article and no “new” paper 
published less than that. Compared with the results of Fondevila-Gascón et al. our 
leading “traditional” papers fall short of their four newspapers at 41.29% of their 
image number, however our “new” papers outperform them at 157.80%. 
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Our second thesis was that significantly more visual elements have self-stand- 
ing contentual value in the “new” media and the images appear in roles that does 
not exist in the "traditional" media at all. The thesis got confirmed, though less 
strongly. In the "traditional" media group 8596 of those articles that have at least 
one visual element uses them only in illustrative roles; the same value in the “new” 
media group is 7396. Given the short timescale of the study (one day per paper) the 
difference is not that convincing. However, it is clear that Fondevila-Gascónss state- 
ment is true for Hungarian media, too: “[...] photos have only relative meaning 
for the presentation of the content. They might serve as eye-catcher but they are 
neither important in terms of transporting, nor communicating an own message”. 

There exists, however, a role for the visual elements in the “new” media that can- 
not be found in the “traditional” media: the interaction of image and text, the two 
presenting together a new meaning that cannot be reached by only one of them 
alone. The pages !!444!!! and VS.hu are notable for their usage of such interactions. 

The ratio of images continues to grow in the online media (Veszelszki 2008). 
A current example: in October 2015 the site that previously used the least visual 
elements in its articles by far, MNO.hu, switched to a new page and new image 
policies - we did not yet gather data from the new page but it clearly uses images 
more often. 

The online public grows accustomed to images presented as self-standing con- 
tentual elements. This is why digital media needs to combine image and text. The 
process of the “pictorial turn" will surely lead to even more papers using images 
as self-standing contentual elements, equal to the text. 


References 


Fondevila-Gascón, Joan-Francesc - Seebach, Swen - Cardona-Pérez, Carlos 
(2013): Photography in Digital Journalism: A Comparative Case-Study Anal- 
ysis Between Newspapers in Canada, France, Italy and Spain. Research Open 
Journal of Science and Technology 1/5: 51-62. 


Nyíri, Kristóf (2000): A gondolkodás képelmélete [Picture Theory of Thinking]. 
Nyelv, megértés, interpretáció - A nyelv mint a kortárs filozófiai áramlatok közös 
problémája. Conference 5-6. 10. 2000. http://hunfi.hu/nyiri/ELTE 2000 conf. 
htm. 


Steensen, Steen (2011): Online Journalism and the Promises of New Technology. 
Journalism Studies 12/3: 311-327. 

Veszelszki, Ágnes (2008): Vizuális megoldások a kreatív szóvegalkotási gyakorla- 
tokban [Visual Solutions of Creative Writing Exercises]. Anyanyelv-pedagógia 
2008/1. http://www.anyanyelv-pedagogia.hu/cikkek.php?id=33. 


Images in the Hungarian Online News 121 


Veszelszki, Ágnes (2012): Connections of Image and Text in Digital and Handwrit- 
ten Documents. In: Benedek, András - Nyíri, Kristóf (eds.): The Iconic Turn in 
Education. Visual Learning Vol. 2. Frankfurt: Peter Lang. 97-110. 

Veszelszki, Ágnes (2014): Information Visualization: Infographics from a Lin- 
guistic Point of View. In: Benedek, András - Nyíri, Kristóf (ed.): The Power of 
the Image. Emotion, Expression, Explanation. Visual Learning Vol. 4. Frankfurt: 
Peter Lang. 99-109. 

W1 = http://444.hu/2015/07/23/30-legnagyobb-ceg. 

W2 = http://444.hu/2015/07/23/nemeth-zsolt-visszakuldhette-a-trefarepat-az- 
asszonnyal-a-konyhaba. 


W3 = http://vs.hu/mega/menekultek-magyarorszagon. 


Trischa Goodnow 


The Selfie Moment: 
The Rhetorical Implications of 
Digital Self Portraiture for Culture 


1. Selfie and Rhetoric 


When a shard from a bowl is unearthed from an ancient civilization, archeologists 
and anthropologists learn much about the people who produced it. They discern 
aspects of life in that time from the way the bowl was made, used, and even 
decorated. We might call these accidental traces as the original purpose was not 
to speak about their life but to live it. Alternately, rhetorical critics study purpose- 
ful traces, those artifacts that people construct to tell the world, both present and 
future, who they are. Traditionally, rhetorical critics examined public speeches to 
infer elements of the immediate and cultural situation in which speeches were 
produced. More recently, however, critics have begun to examine all types of ar- 
tifacts in a culture to examine their rhetorical import. In this essay, I examine the 
digital self-portrait, also known as the selfie, to mine the rhetorical implications 
of this phenomenon for culture. As Hall (2014: loc 132) suggests, self-portraits 
"have often been in the vanguard of cultural developments, influencing their own 
society's sense of identity and selfhood”. Consequently, it is appropriate to place 
the selfie in the vanguard of contemporary culture. 

The estimates of the numbers of selfies taken on any given day is approximately 
93 million (Kennermer 2014). With this staggering number it is clear that some- 
thing is going on. Academic studies often focus on the motives of the individual 
selfie taker. For example, some studies examine the narcissistic nature of selfies 
(Weiser 2015). Additional studies focus on the differences between the way men 
and women take selfies (Albury 2015), the functions of selfies as visual conversa- 
tion (Burns 2015), and even what the conversation about selfies says (Sorokowski 
et al. 2015). In virtually all of these studies, the selfie is considered as a discreet 
act that speaks to and of the author. I propose here to examine the phenomenon 
writ large as an artifact of culture rather than the individual. 

Selfies, taken as a whole, can be mined to determine the rhetorical implications 
they pose. I argue here that selfies reflect cultural perceptions about narrative, 
time, and values. To undertake this study, I begin with a general discussion of 
selfies. Then, I will explore each of these areas of cultural perception along with 
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theoretical foundations for each aspect, before, finally drawing implications from 
this analysis. For this study, I examined selfies in general, as well as, individual 
selfies from which to draw conclusions. 


2. The Selfie Phenomenon 


The first known selfie is also one of the first known photographs. In 1839, Robert 
Cornelius sat motionless for three to 15 minutes to capture his own visage on 
film (W2). The cell phone reinvigorated the notion of the self-portrait for the 
average person as digital technology made taking pictures for no particular rea- 
son both easy and inexpensive. With film photography, the average person took 
photos for a purpose because of the expense and the time it took to have the film 
developed. However, with digital photography, readily available with most smart 
phones, the "developing" is instantaneous and cost is negligible beyond the device 
itself. Further, most selfies are uploaded to social media so there is no expense 
in printing. As a result, there is no barrier to the impulse to take random, seem- 
ingly meaningless photographs. Hence, the evident probability of selfies on social 
media. I argue here, however, that the selfie is not meaningless. The selfie reveals 
the current culture's perceptions of narrative, time, and values. The next sections 
explore these aspects. 


3. Narrative and Time 


A narrative is the telling of a connected sequence of events that have a beginning, 
middle and end. Fisher (1984) suggests that humans make decisions based on the 
stories we hear. He opposes this to the rational world paradigm where humans 
make decisions based on rational argument. In order to make decisions based 
on narrative, the story must be internally consistent as well as externally consist- 
ent. In other words, the story must hold together as a story and make sense with 
what is known to be true in the real world. I argue elsewhere (Goodnow 2005) 
that news photographs affirm, challenge or reaffirm known and emerging social 
narratives. Consequently, the photograph has the power to provide reasons from 
which to make decisions. 

In his 1989 book Art as History Maurice Berger (1992) argues that news photo- 
graphs are traumatic because they are moments caught in time with no beginning 
and no end. The viewer is helpless as to know the events that led up to the photo 
and cannot stop the photo from unfolding. Consequently, the viewer is held to 
that moment when the image was taken. Though Berger talks about the news 
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photograph, the same theory can apply to other photographs as well. Any photo 
is a moment caught in time without a beginning and without an end. 

Narrative is interconnected with the notion of time as narratives happen with 
the passage of time. While narrative is about the arc of events during a specified 
time, time itself is an elusive concept. We denote time in seconds, minutes, hours, 
days, years, decades, epochs, etc. How we perceive time impacts how we approach 
certain tasks, people, and events. A half an hour in the dentist chair seems to last 
an eternity while a half an hour laughing with your best friends goes by in what 
seems like a minute. Photographs are snapshots of time. 

Historically, photographs recorded events, either personal or public. They might 
record a rocket launch, a political candidate at a rally, a wedding, a birthday party 
or a vacation. They recorded points in a narrative. The selfie eschews the notion 
of narrative. The selfie is often an image without context. Though some types of 
selfies do show some background, many selfies feature just the face of the picture 
taker. In fact, “Selfie City,’ a website devoted to collecting selfies from major cities, 
just features images that contain the face of the picture taker. In these instances, 
selfies are points in time with no context. Granted, a caption may explain more 
of the story behind the selfie. However, if a story contains a sequence of events, 
likely the caption will only illuminate one point in a potential story. As a result, 
selfies are not part of a larger narrative. 

The argument can be made that by looking at a series of selfies a story unfolds. 
While this may be true, most selfies are not meant to be viewed as part of an on- 
going narrative. Rather, selfies are discreet images meant to stand on their own. 
What does this mean for and about culture? A recent generation was known as 
the “me” generation. Narcissism runs rampant throughout the world, particularly 
in U.S. culture. The notion that a picture of just your face would be appealing to 
friends and any potential viewers on social media reveals a great deal about the 
cultures need and interest in understanding the greater narratives from which 
good decisions can be drawn. This lack of interest in the whole story is a symptom 
of what Rushkoff (2013) calls present shock. 

Present shock occurs when we are present-oriented without regard to our his- 
tory or our future. The dangers of present shock manifest itself in a lack of conti- 
nuity and the need for something to take place immediately. Essentially, present 
shock is an endless cycle of needing excitement in the present without the patience 
for a longer term payout. The selfie expresses just this. It says, "Here I am in the 
present... No wait, now I'm in the present... no wait, NOW I'm in the present!" 
The selfie is relentlessly a record of the present, without regard to the past or future. 
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4. Values 


Aristotle in The Rhetoric defines the three public speaking occasions: delibera- 
tive (legislation that is future oriented), forensic (judicial that is past oriented), 
and epideictic (ceremonial that is present oriented) (Herrick 2009: 84). Aristotle 
contends that epideictic address seeks to reaffirm the values prevalent in society 
(Herrick 2009: 86). Most contemporary forms of address can be identified as one 
of these types of speeches, even those forms of rhetoric that are non-verbal. Selfies 
would fall into the epideictic category as they seek to celebrate something, even if 
that is just the self. What is relevant here is the values that selfies espouse. I identify 
three values that correspond to the three types of selfies commonly found. 

In order to discern these types, I assigned the 40 students in my Visual Rheto- 
ric class to examine a minimum of 20 selfies, either their own or those found 
on social media sites, and categorize them. Through a process of elimination, 
we developed three categories that encompassed all of the sample selfies. These 
categories are adventure, popularity, and attractiveness. Each of these categories 
relate a corresponding value that can be found prominently in society. In addition, 
these categories are decreasingly contextualized, relating to the narrative and time 
aspects of the selfie phenomenon. I discuss each of these categories here. 


4.1 Adventure 


The adventure category usually relates one of two experiences, either daring ad- 
ventures or location adventures. Daring adventures are those selfies where the 
person is doing something physically challenging. These images include situations 
such as skydiving, bungie-jumping, rock-climbing, or finishing a marathon. The 
idea behind these types of adventure selfies is to illustrate that the picture taker 
is also a risk-taker. 

The second type of adventure is the location adventure selfie. These images 
show the taker in the context of an exotic place. Such images may show things like 
the subject at the beach, the Roman Colosseum, the Louvre, the Lincoln Memo- 
rial or other such recognizable places. These selfies uphold the primary value of 
exploration. Based on the Frontier Myth common in Western culture, exploration, 
of conquering uncharted lands (experiences), is a value that is cherished. 

Adventure selfies illustrate that the taker is participating in the value of explora- 
tion. These images are highly contextualized. Hence, they relate more of a narrative 
that can be assumed. When a selfie is posted in the adventure category, the viewer 
wonders about the story. So, if someone is seen outside the Louvre, the viewer 
can assume there is a story about the trip that resulted in the image. Though the 
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selfie will most often be accompanied by a one sentence caption, such as, “At the 
Louvre, the narrative itself is incomplete. Consequently, while the adventure selfie 
contains more context, it still plays into the lack of full narrative. 


4.2 Popularity 


The popularity selfie often depicts the picture-taker with one or more friends. 
Because of the nature of the devices used to take the selfie, the picture-taker is 
most often in the center of the image. Even if the person is standing on the edge 
of the group, the tendency is to center the taker. Consequently, the picture-taker is 
always center stage. However, what is important is that the picture-taker is viewed 
as having friends. Not only that, but the images usually picture the subjects as 
having a good time. 

These images espouse the values of camaraderie and support. Since we live in 
a narcissistic time, being popular enhances the value of the self. Popularity selfies 
reinforce the notion that the picture-taker is popular. However, these images lack 
context in most situations. As a result, the narrative of the image is lacking. The 
selfie-taker is the only important element in the image. The moment of the image 
is most important as what came before or what comes after is irrelevant. The popu- 
larity category functions to illustrate the state of the picture-taker in the moment. 


4.3 Attractiveness 


This category of selfie is the most popular type and consists of two subcategories, 
the workout selfie and the facial selfie. The workout selfie is interesting in the 
breakdown between men and women. Images of women in this category usually 
depicts the taker in workout gear and often depicts only the body with the face 
cut off. Men, on the other hand, rarely cut off their heads in the photos. Pictures 
of abs and biceps are prevalent. The other interesting observation available in 
this subcategory is the method of taking this type. Often the subject takes the 
picture in a mirrors reflection. Hence, the viewer observes the subject examining 
themselves. This clearly indicates that the subject is the center of attention and 
seemingly deservedly so. 

On occasion, these images will be accompanied by a “before” shot. Conse- 
quently, there is an evident narrative; "this is what I looked like before and now 
I'velost weight and look great”. There is a sequence present. More often than not, 
however, there is just the image in workout gear, showing off the subject's physique. 
In this case, the image is of the moment, revealing where the subject is now. 

The facial selfie only reveals the face, with little to no background. This is per- 
haps the most revealing selfie for culture. As mentioned before, the website, Selfie 
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City, only collected this type of image and managed to cull over 3200 facial selfies 
from five continents (W1). Without context the facial selfie can only be about the 
self. In fact, one could argue that the purpose of the facial selfie is less to share an 
image than to garner "likes" and comments. In this way, the subjects self-esteem 
is reinforced because of the potential popularity of the image. A common type of 
facial selfie is the make-up free selfie which certainly requires a response. Hence 
the value of pride is paramount in the attractiveness selfie. This type of selfie also 
reinforces the “now” focus as the subject needs confirmation now. 


5. Implications 


An examination of the selfie phenomenon reveals that the popularity of this type 
of image communicates the “presentist” nature of contemporary culture. With 
the focus on now, cultural narratives become less important. When that happens, 
planning for the future also has less importance since all that matters is now. The 
problem with this perspective is that it denies the connectedness between events, 
things, and people (Rushkoff 2013: 240). The inability to make connections to the 
past and plan for the future results in a fractured existence. It's like the person with 
no short term memory; they have to keep asking why they are where they are. 

Further, with the emphasis on self, other actors in the on-going story become 
unimportant or even irrelevant. The focus on self inhibits the civility in culture. 
Some tourist destinations have banned selfie sticks because they were causing 
problems with other tourists, including injuries. Tourists taking pictures of them- 
selves also limits the interactions with others. Before the advent of the selfie, one 
would ask a fellow visitor to take a picture and perhaps strike up a conversation. 
Thus, the totality of the experience was enhanced. Now, we need not ever talk with 
a stranger because we are self-sufficient. The less we interact with others, the less 
empathetic we are to others. I do not mean to claim that selfies make us selfish. 
Rather, I believe they are symptomatic of a larger cultural phenomenon. 

Finally, looking at the values that the types of selfies represent, a further de- 
piction of the self in culture is evident. Values represent exploration, pride, and 
presence. While the first value of exploration echoes persistent cultural values, 
pride and presence are self-centered and counter-intuitive to democratic values. 
Consequently, the individual's importance breaks down the value of community, 
presaging a decline in civility. All of these implications are not necessarily har- 
bingers of doom. Rather, they are an assessment of where culture stands today. 
Understanding these implications can enable citizens of culture to make more 
informed choices for the future. 
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6. Conclusion 


By looking at the various types of selfies, we can come to a greater understanding 
of what selfies say about our culture and our future. These purposeful traces reveal 
the way that we consider time and narrative. Selfies provide evidence of our pre- 
sentist leanings. We are concerned with the here and now. This has implications for 
how we plan and prepare for the future. This presentist culture is further evidenced 
by the values selfies espouse. With focus on the selfie-taker, connections to other 
people, events and time are minimized. While it is easy to discount the importance 
of selfies, it is evident that the selfie is a valuable indicator of the status of culture. 
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Selfies as interpersonal communication 


We define selfies as images or videos that one takes of oneself, primarily alone, 
but sometimes among a group of others. Manovichs 2015 study of selfies found 
that only about 496 of the images posted on Instagram in a single week were self- 
ies. While that is a relatively small percentage of the overall vast number images 
captured, it nonetheless translates into about three-quarters of a billion pictures 
that currently reside on Instagram. 

Initially considered the domain of teens, the selfie phenomenon now runs the 
gamut from religious leaders to politicians and practically everyone in between. 
Franklin Graham (son and heir of the iconic US evangelist, Billy Graham) takes 
numerous selfies, while President Obama has wielded a selfie stick in Alaska. 
Politicians across the spectrum now find selfies as routine as shaking hands or 
kissing babies. Indeed, a colorful story splashed across the front page of Boston's 
leading newspaper, dubbing the states governor “His Excellency Governor Selfie" 
for his predilection to snap a shot at every opportunity, even when he encounters 
a cute dog (Miller 2015). 

Yet harsh criticism has also been leveled at the selfie and those who take them. 
For instance, Robert Lucky has called them “personal propaganda” observing that 
photos had previously been considered "treasured keepsakes" and were now used 
primarily for self promotion (Lucky 2015), and this description might be char- 
acterized as polite relative to other terms that have been applied to them. Among 
manifold negative responses to selfies have been comments directed at Mr. Obama 
for participating in a selfie at the funeral of Nelson Mandela. Nor are celebrities 
immune to criticism; popular US TV personality Al Roker had to apologize for 
his insensitivity after taking a smiling selfie with hurricane wreckage in the back- 
ground (Wagner 2015). Beyond the personal politics and moral indignation that 
selfies have provoked, is the fact that their production can be quite dangerous. 
With disturbing frequency, people go to such extremes to take a compelling selfie 
that they put themselves in harm’s way, with fatal consequences (Diehl 2015). 

Yet criticism also extends to the world of scholarship where not only selfie tak- 
ers are critiqued for various shortcomings, but so too are those who study selfies 
(Tifentale 2014). We would like to add our criticism of some selfie studies, because 
they often do not give sufficient regard to the communicational aspects of selfie 
production, consumption, and coproduction. More specifically, we see selfies as 
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often filling an important conversational role. Of course this is not true for all 
selfies, but it is, as we endeavor to show below, a sufficiently important aspect to 
merit systematic inquiry. 

In this sense, our analysis seeks to highlight the turn towards visual commu- 
nication, which, while we admit this is a contested viewpoint, has not received 
sufficient attention from philosophical or communication research perspectives. 
That is to say, many analyses of this new practice may be accused of failing to see 
them as a rich form of reciprocal communication, even as a broad front has been 
opened about the inability of young people to communicate (Turkle 2015). Ac- 
cording to this school of thought, the absence of meaningful conversation may 
be laid at the doorstep of our communication technology. We take issue with this 
"soft technological deterministic" position, holding that people use the commu- 
nication technology available to get done what they want, the way they want. Of 
course, there is more to this point than can be captured here in a few words, but 
our point is not to criticize Turkle, but rather to highlight the fact that people use 
communication technologies that serve their purposes rather than address some 
externally defined (often elite-driven) set of standards. 

We see that selfies do much to effectively communicate among friendship cir- 
cles and beyond certain sentiments and ideas, and especially emotions, much 
better than a carefully written essay or letter, or public address. Moreover, there 
may be high degrees of intriguing ambiguity and multi-layered meanings to self- 
ies that make them a combination of game and puzzle, adding further to their 
attractiveness. We suggest that selfies are symbols, and as symbolic representations 
of self they are signs that evoke or provoke variegated meanings, and thereby are 
communicating ideas that competent viewers can discern (Hefner 1990). 

It is worth pointing out that for hundreds of thousands of years evolution- 
ary forces have attuned human beings to become adept at reading each other's 
faces to understand and exploit the thinking behind the mask of ones visage. By 
the same token, with effort and experience many facial expressions can be sup- 
pressed, giving rise in English to the expression “poker face; blocking the “mind 
reading" efforts of the one gazing upon the individual's expression. But here we 
are concerned about the ability to communicate using facial expressions, often 
with intentionality and effort, just the reverse of the point made in the preceding 
sentence, which is set forth to provide a juxtaposition. 

Hence, the question of selfies as a form of human interaction and commu- 
nication can now move to the center of our argument. In this regard, we wish 
to present data from a US survey to help shed light on the process from a com- 
municational perspective. Specifically, although there have been a small number 
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of studies of selfies as communication processes, little systematic evidence exists 
concerning the generalizability of observations concerning the use of selfies "in 
the eye of the beholder" (but exceptions include Katz- Thomas Crocker 2015). 
Hence our research seeks to understand the communicational aspects of selfies by 
surveying an introductory communication class at a large northeastern American 
university in the fall of 2015. Although of course not representative of the general 
youth population, 471 freshmen students successfully completed the instrument 
(8196 female, 19% male). Nearly all were 18 or 19 years old. 

In terms of selfie production, all had heard of, and nearly all had taken a selfie 
(only seven students, or 1.596, said they had not). As to the intensity of selfie 
production, over half (5696) said they had taken a selfie with the past 24 hours. 
Fourteen percent had shared one selfie in that time period, nine percent had 
shared two, and seven percent had shared three. About 1096 of the sample said 
they had shared 10 or more selfies in the past 24 hours. This result suggests high 
levels of selfie production among this age cohort. Looking over a longer time span, 
one week, 29 students (about 496) reported sending more than 100 selfies, which 
of course is not a precise count, but rather a general indication of magnitude. 

Are selfies designed for friendship circles rather than the general public or 
unknown others? To get at this question, we asked students to agree or disagree 
(on a five-point Likert scale) with the statement “selfies should only be shared with 
friends" The sample was fairly evenly split on this question, with about one third 
agreeing with that sentiment, one third being neutral, and one third expressing 
disagreement. However, when the question was formulated differently, "its okay 
to share selfies publicly; 6996 agreed or strongly agreed, 2296 were neutral, and 
9% disagreed or strongly disagreed. Hence while selfies in general may be suitable 
for either public and private consumption, or both, there is a significant propor- 
tion of the sample that feels selfies are objects for personal or friendship-circle 
consumption only. (The public versus private dimensions of selfie production and 
consumption may be an important topic for future research.) 

Selfies are by definition an intentional production, and the question of stag- 
ing vs. spontaneity is of interest here. In terms of the question “I often carefully 
stage my selfies; half of the respondents answered affirmatively (agreed/strongly 
agreed) while a quarter were neutral and another quarter disagreed or strongly 
disagreed. Our answer to this question would emphasize the intentionality be- 
hind selfie production, a point that further implicates their role as a form of 
communication to others. (As in so many areas, though, staging could also be 
integral to the personal documentation activity, for both ones own sake and that 
of posterity. However, even going beyond posterity, it could be readily argued 
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that self-documentation is still a communicative act, created now for the future 
self to consume.) 

An interesting finding was the relationship between the questions, "I often 
carefully stage my selfies” and “selfies are meant to be informal”. Although one 
would expect that those who think that a selfie should be informal would also be 
those who do not carefully stage their selfies, this was not the case. A statistically 
significant proportion who strongly agreed that selfies should be informal, were 
also more likely to strongly agree with the statement that they carefully stage 
their selfies. 

Another aspect of the intentionality of selfie production and sharing is the 
notion that the act of selfie production is designed, perhaps less for personal 
gratification, than it is to manipulate the impression that others have of the selfie 
producer. We found some evidence in support of this proposition when we asked 
the respondents about their motive for selfie production. In response to the ques- 
tion “I share selfies to impress people,’ about one third agreed with this state- 
ment (696 strongly agreed, 2696 agreed). Twenty-six percent of the respondents 
were neutral, while twenty-nine and thirteen percent respectively disagreed and 
strongly disagreed. While this is not a resounding endorsement of the principle, 
there is nonetheless evidence that for about a third of the sample this was the case. 

It is worth pausing here to note that the topic of motivation is hard to get at 
through direct survey questions. Self-reports of motive tend to be notoriously hard 
to validate, in part because the actor in question may not be aware of their true 
motives, and in many cases the idea of a "true" motive can be hard to pin down. 
The notion of social desirability also comes into play, since some individuals may 
not be willing to admit to behavior for less than socially sanctioned rationales 
(Fisher-Katz 2000); in this particular case, an intent to impress. However, given 
that nearly two-thirds of our respondents said it was important to look good 
in a selfie (62.296) suggests that undergraduates who post selfies are likely to be 
concerned with cultivating a positive impression. The extended self is not merely 
that possessions, text, and images happen to reflect identities, but that they are by 
their very nature instrumental in communicating those identities. 

The two-way communication aspect of selfies is also worth considering. In- 
deed, it appears that there can be something approximating an interaction effect 
between selfie producers/centers. We believe this was the case, so we asked the 
question: ^I send selfies back in response to the selfies I get”. Of our respondents, 
1396 said they strongly agreed with this sentiment, over half (53%) agreed, while 
1896 were neutral, 1696 disagreed, and 796 strongly disagreed. 
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One of the aspects we were unable to probe in any detail via this survey, but 
hope to do so in future surveys, is the “demand” characteristics of photo exchanges. 
For example, to what extent do those who send selfies back into in response to 
the selfies they get do so because they feel obliged to do so? What extent do they 
do so because they feel they wish to engage in conversation-like interaction, or 
perhaps simply because of the stimulus or competitive dimension in light of an- 
other persons selfies? In terms of our data, there was something of a penumbra 
concerning this that we were able to probe (although we were not able to do so 
directly). We did so by the question “I am very interested in how my friends react 
to my selfies”. Here we found close to half of the respondents affirming this at- 
titude (1096 strongly agreed and 3696 agreed), 3196 were neutral and one quarter 
were not supportive of that attitude (1796 disagreed and 796 strongly disagreed). 

Obviously, our investigation has only scratched the surface here. Specifying me- 
dium and audience size might help further illuminate this aspect, since there may 
be different expectations in responses to selfies, depending on the platform they 
were shared on and how many individuals could reasonably be expected to view it. 
Such an inquiry would also provide further information about intentionality, since 
we presume that the motivation to send a selfie sent to a single individual would 
be different than a selfie put on a public account available for thousands to view. 

Summing up, this is not a definitive survey, and as a research vehicle has a 
plethora of methodological shortcomings; hence any generalizations must be 
exceedingly tentative. Yet it may be that some data are better than none. In that 
light, from our evidence we would argue that selfies are a meaningful form of 
interpersonal communication, and that they provoke an array of responses that 
have been previously found in both face-to-face interchanges and conversation. 
Survey responses suggest that competitiveness, friendship circles and grooming, 
and the creation of in-group rewards and out-group barriers, are all processes 
that are played out within the context of selfie production and consumption. 
As such, mobile technologies, such as the smart phone, are new frontiers of hu- 
man communication that allow new forms of visual interaction to emerge. These 
forms allow for richness, playfulness, and competitiveness, as well as jealousy and 
frustration (and danger). Hence there is no reason not to encompass this form of 
expression into the panoply of communication tools which have played important 
roles in the cavalcade of human interaction and popular culture. These other forms 
have included floral bouquets as communication tools arrayed so as to convey 
complex sentiments. Likewise, stamps on envelopes have been used as a form of 
meta-communication to enrich, or in some cases hide, messages. Therefore, selfies, 
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far from a unique or new form of communication, are a continuation of existing 
visual communication strategies, adapting, as ever, to newer technological tools. 

Turning briefly to the philosophical dimension, which can only be noted in 
passing, the proliferation of selfies represents further confirmation of what might 
be called a *visual turn" in philosophy. As such, it adds to the opening of the way 
for those who believe that humans think, gain insight through, and even develop 
arguments, via images. In this sense, our findings provide ammunition against the 
position of those who, like Nelson Goodman (1976), argue against the possibility 
of visual argumentation. 

The selfie (and accompanying selfie stick) as a mass obsession may be a tran- 
sient form of communication production, much as was the singing telegram. But 
we would not bet on it; there is no reason to expect the face itself, and its use as a 
form of communication, enrichment and expression, to fade from the core set of 
interests of humans. The power of the facial image, containing as it does so much 
information and meaning, will doubtless remain an important feature of the way 
we interpret the world visually, emotionally, and psychologically. Truly, we live 
in a world of images. Kristóf Nyíri aptly recognized this during his comments at 
the 2015 VLL6 conference in Budapest when he said, "Children and teens live in 
images" Indeed, it's rare to find a human who does not. 
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Ágnes Veszelszki 


#time, #truth, #tradition. An image-text 
relationship on Instagram: photo and hashtag 


This chapter aims to examine the relationship between image (photo) and text 
(hashtag), on the photo sharing social network Instagram, through the examples 
#time, #truth, #tradition. 


1. What Is a Hashtag? 


A hashtag is a type of label or metadata tag primarily used on social networking 
websites and microblogging services. It makes it easier for users to find content of 
the same topic. Hashtags are created by inserting the hash character (#)' in front 
of a word or unspaced phrase. 

The tagging system was initially popularized by Twitter’, and later taken over by 
Instagram, Facebook and other social networking websites as well. Now hashtags 
trend beyond social networking sites and digital communication into other media 
like television, print and they even appear in spoken conversations. The expres- 
sion itself has not only become a verbalized form in orality but has also triggered 
changes in nonverbal communication: the hashtag sign can be shown by using 
the index and middle fingers from both hands laid over each other, rather than 
saying "hashtag" (Parker 2011; Kamer 2013). Because of its widespread use, the 
word hashtag was added to the Oxford English Dictionary in 2014. 

Metadata (in a relationship with images) has the "ability to append linguistic 
signs to an image (or other data object), to facilitate its classification, archiving, 
retrieval and indicate provenance (authorship, ownership, conditions of use)" 
(Rubinstein-Sluis 2013). Searching on a hashtagged word on a social network- 
ing website will display all content so labelled on that website. With this sorting 
and searching function, however, hashtags not only connect different content or 
thematic blocs, but also connects users having similar fields of interests (“hashtag 


1 In the English language, the # symbol is the number sign or the hash as Northern 
Americans call it (not to be confused with the sharp sign # in music, the abbreviation 
No. or the pound sign in North American English). 

2 Its first appearance on the microblogging site Twitter is commonly associated with 
Chris Messina (W1), who used this sign in a message in 2007 the following way: "how 
do you feel about using # (pound) for groups. As in #barcamp [msg]?" [23 Aug 2007]. 
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serves as [...] a symbol of membership of a community,’ Yang et al. 2012). It is 
often used as an instrument by social movements (for example, with the hashtag 
#bringbackourgirls Nigerian students directed attention to the fact that 270 girls 
were kidnapped from their school in 2014). Hashtags are important for social sci- 
ences too, as they make it possible to search and analyse opinions from different 
individuals about an event (Rambukkana 2015). Marketing professionals have 
also recognised the potential in hashtags (Ting et al. 2015: 16): they can use these 
labels to measure the effectiveness of promotion in social media. 

In addition to its above-mentioned basic functions, hashtags are also used to 
abbreviate messages and to add some kind of a stylistic touch to what is being said. 
“Hashtags are deictic, indexical - yet what they point to is themselves, their own 
dual role in ongoing discourse" (Rambukkana 2015). The metacommentary writ- 
ten after the hash can be used to indicate the user's attitude toward the hashtagged 
content (an apparently serious text can be made funny or ironic by adding the 
right label to it; cf. Parker 2011). In its broader sense, the hashtag may be taken as 
the marker of epistemological modality in relation to the text.’ 

Hashtags go unregistered and uncontrolled, so users can create as many tags as 
they want and use them the way they want to. Still, there are collections of advice 
on how to make hashtag campaigns. According to Cohen (2015), a good hashtag 
(that is suitable for marketing purposes) is unique, distinctive, easy to remember 
but not too general, short but meaningful, not too abstract and includes no slang 
elements. It is often advised that the initials of multiple word hashtags should be 
capitalised. Users should also make sure that there is only one way to spell out 
their hashtag (“if a hashtag can be misunderstood, it will be misunderstood; e.g. 
#SusanAlbumParty vs. #SusAnalBumParty; Slegg 2014) and check whether it has 
been used earlier for other purposes (Hill 2012). 

Certain tags most likely go hand in hand with others. Co-occurring, multiple 
hashtags are called in this paper hashtag chains (on the relationship of hashtag 
chains and phrasems cf. Veszelszki 2016). Analysing various contents shared 
on Instagram (Cohen 2015), the highest interaction is triggered by 11 or more 
hashtags, so on this platform the more hashtag someone uses, the more efficient he 
or she will be in building community. Hashtag chains typically relate to the most 
popular topics of amateur photography (travel, touristic sights; food and drink; 
fashion; selfie 'self-picture'and work), and their structure prototypically follows 


3 Forexample:"I cant decide which series to watch this evening. #firstworldproblems”. The 
expression "first world problem" is a self-ironic reflection on the fact that for the user 
the mentioned issue is the greatest problem in life. 
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the user name, text, hashtags order: Its a classic mille feuille but with a twist... 
the flavors of bananas! #recipeoftheday #syntaghthshmeras #millefeuille #napoleon 
#dessert #sweets #deliciousrecipes #recipes #food #foodlover #foodblogger #foodtricks 
#instafood #instagood #instadaily #instalover #instamood #foodpics #bananas. Or: 
Cica szelfi #selfi #selfie #szelfi #cat #macska. As the second example shows, hashtags 
are often made of spelling variants or synonyms of the same word. Using multiple 
hashtags in the middle of the text makes comprehension quite difficult (e.g. Very 
#cute #lovely #kitten #cat #kitty! I so #love it!). 

Based on empirical research, hashtags are classified into three main groups 
(Csire 2015; with my own observations and examples): 


1. Like-hunter tags are added to images to boost the number of views (e.g.: #fol- 
lowme, #likeforlike; #instadaily, #instalove; #photooftheday). They do not form 
an integral part of the image, their only aim is to obtain new likes and followers 
and that way they lead to a certain microcelebrity which “is a mind-set and 
a collection of self-presentation practices endemic in social media, in which 
users strategically formulate a profile, reach out to followers, and reveal per- 
sonal information to increase attention and thus improve their online status” 
(Marwick 2015: 138, according to Senft 2013). 

2. Thematising tags usually relate to the topic of the photo, how it was made (black- 
and-white, no-filter [#nofilter]), its atmosphere, or sometimes the persons on the 
picture (#girls, #friends, etc.), objects (#food, #cake) or events (#wedding, #confer- 
ence), so this way they contribute to the searchability of similar contents. 

3. Contextualising tags complete posts with the user's emotions, mood or the 
circumstance of taking the photo, such as: #cominghometothis, #annapostedit, 
#grüsseausdertaiga. Such hashtags are much more characterised by uniqueness: 
they do not want to enhance searchability but to add extra verbal information 
to the visual content. For this reason, they are one-time, non-recurrent texts. 


As one of the main functions of hashtags is to facilitate searching, their presence 
is relatively constant on the internet. This stability‘, however, can only be true 


4 Examples of this fixed form include: #mik (acronym of Hungarian Instagram Commu- 
nity), #yolo (you only live once), #swag, #sundaymorning; #bestoftheday, #picoftheday, 
#worstnightmare, #grexit. The same need for stability may motivate the usage of joker 
suffixes, such as -porn and -gram (deriving from the word Instagram): coffee porn, 
foodporn, wordporn, lobster porn; latergram, travelgram, foodstagram; as well as pre- 
fixes, such as insta- (also deriving from Instagram): instafood, instatravel, instagood, 
instamood, instadaily, instasize, instahun, instanight (on further linguistic characteris- 
tics of hashtags: Thode Hougaard 2014). 
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to like-hunter and thematising hashtags, because contextualising hashtags are 
unique and casual. 


2. Corpus and Method 


The present study aims to describe the hashtag as a new, image-bound, mini- 
malistic type of text. For the empirical analysis, five hypotheses (presented at the 
results) were formulated which combine the potentials of qualitative and quan- 
titative analyses. 

The examination was carried out on the Instagram photo sharing site. High- 
field and Leaver outlined emerging methods to study uses and activity on the 
image-sharing app and social media platform Instagram. They found that "the 
importance of tagging on Instagram [...] has conceptual and practical links to 
the hashtags employed on Twitter (and other social media and "Web 2.0’ plat- 
forms), with tags serving as markers for the main subjects, ideas, events, lo- 
cations, or emotions featured in tweets and images alike" (Highfield-Leaver 
2015)."So far, textual content has dominated social media research, particu- 
larly for large-scale analyses; this is in part due to the ease of collecting and 
processing text in comparison to images. [...] Preliminary research into In- 
stagram has offered large-scale analyses of images from specific locations" 
(Highfield-Leaver 2015, mentioning Hochman-Manovich 2013). With the 
hashtag function the images of Instagram also include "fragments of metadata" 
(Wendt 2014: 37). 

As a start, I selected three keywords that matched the theme of the VL-con- 
ference (#time, #truth, #tradition) and used them as hashtags to search related 
content. The results were sorted using two methods: first, by choosing photos with 
the highest number of likes (indicating popularity) and second, by selecting the 
most recent Instagram photos on the day of examination (25 October 2015). For 
each keyword 100 photos were saved together with labels. This corpus was later 
completed with a sample containing another 100 items selected from the latest 
photos, serving as control corpus, to balance (at least to a certain degree) the bias 
caused by the keywords. In line with Instagram’s privacy policy, only publicly 
posted images were examined. This 400-item corpus was analysed according to 
the aspects specified in the hypotheses. The analysis was based on a sample (what 
I refer to - according to Rocheleau-Millette [2015] - as small data’), so its results 
may not necessarily correspond to the results produced by automatic analyses 
of big data. Using a different sampling method can produce different results. 
After presenting the data, I used a mixed methodology, taking advantage of both 
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qualitative and quantitative data collection and analysis methods. This method 
is accepted as valid by Highfield and Leaver, who deal with Instagram research 
methodology. They found that “Studying data through qualitative methods is criti- 
cal to understanding how social media are used in non-standard ways, identifying 
practices that might easily be missed through automated analyses. [...] For visual 
platforms such as Instagram, this is even more critical, for the textual and graphic 
components of a post each offer key information, and analysis needs to take into 
account both aspects” (Highfield-Leaver 2015). 

My aim was not only to describe the image-text relationships (the semantic 
and semiotic connection points - or with other words: the immediate context — 
of these keywords) on Instagram, but also to complete the time-truth-tradition 
theme of the conference with a new semiotic aspect, namely with what visual 
and verbal signs connect to these keywords - on one of the most popular photo 
sharing sites of our time. 


3. Results 


Searching on the hashtag #time on the date of examination resulted in 24 million 
posts. Not surprisingly, many of the pictures depicted a clock or watch, so this 
sub-corpus contained a much higher share of advertisements than the search re- 
sults of the other keywords. The hashtag #truth was used in more than 29 million 
posts, dominated by religious content (Buddhist texts, Bible and Quran quotes), 
wisecracks, aphorisms, sophisms and inspirational messages. As a characteristic 
feature, these texts were not attached to a picture but a picture was organised 
around them. The keyword £tradition resulted in 2.2 million Instagram pictures, 
primarily depicting traditional, often folk costume, seasonal preparations and the 
architecture or culture of exotic countries. 

After removing repetitions, altogether 2784 different hashtags were added to 
the corpus out of the total 4966. On the list by frequency of occurrence, the 
three keywords are followed by the rather general #love, #life, *happy #instagood, 
#family, beautiful, #followme, #photooftheday and #smile tags. The gesture of 
showing something is not only represented by the pictures but is also reflected 
in the hashtags. The significance of publicly sharing something is primarily em- 
phasized by possessive structures (e.g.: #myart, #mybag, #mybirthday, #myboy, 
#mylife, #mysore; #ourdisneyadventure) or by the Hungarian word muti... [show 
me] (#mutimiteszel [show me what you eat ]). 
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As regards the hypotheses, I found the following: 


3.1 Hypothesis 1: Instagram users will generally tag their photos 
with eleven hashtags, where a hashtag chain is expected to 
contain synonyms and spelling variants of the same forms 


The 400 pictures contained altogether 4966 hashtags, that is an average of 12.41 
hashtags per picture. This figure is a little bit higher than the expected eleven but it 
supports Cohen's (2015) views who recommended at least 11 hashtags per picture 
to trigger the most user interactions. 

Hashtag chains usually contain multiple words having the same semantic field 
(e.g.: #time, #hours, #sundayfunday, timeless, #timepass, #timepieces; #teatime). 
Various morphological forms of the same word may appear next to each other: 
derived words (e.g.: #health, #healthy; cook, cooking); plural and singular forms 
(#fitgirl, #fitnessgirl, #fitnessgirls); clipping (#sis, sisters; #chillin, chilling). The ele- 
ments of a collocation may also appear together (e.g.: #happy #time; #life #time). 
Sometimes the same word appears in different languages in a hashtag chain (e.g.: 
#time #zeit #idö #tiempo). Mistyped forms do not count as intentional word forms 
(e.g.: #autmn, #autum instead of autumn). 


3.2 Hypothesis 2: The major part of hashtags will be in English, but 
at least half of the examined photos will contain hashtags in 
two languages (particularly in the case of users for whom 
English is a foreign language) 


The language of the hashtags was English in almost all of the cases (there were 
some rare instances in the corpus of Russian, Chinese, Korean, Italian, Arabic, 
German and Hungarian tags but almost always next to English counterparts). 
Naturally, the fact that the three keywords were in English strengthened this trend. 
The greater presence of German tags was partly due to the fact that the English 
tradition and the German Tradition are formal equivalents. In most of the cases, 
however, hashtags were given in English even if the text accompanying the picture 
is in another language (e.g.: Bosmocno, evı He 3Haeme, no A 3kenaro ecew Oobpoti 
nouu. Kaxcoyro nouo!!! #jasmin #jasminshor #smile #love #night #sweet dream 
#my #time). 

As the sampling was done by a Hungarian linguist, so after English, the second 
most frequently used language was Hungarian, followed by Spanish, German and 
Russian. Languages with less than ten occurrences, single-occurrence and there- 
fore unclassifiable forms (#bezel), nouns (#Berlin), numbers (#1956), interjections 
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(#braaaap) and vague, uncommon abbreviations (#bzh) were all classified into 
the Other category. Nearly 9096 of all hashtags were in English (if only different 
tags are considered, and repetitions are deleted, this rate is 8296), so non-English 
tags accounted for only 1096 (571 items). This partly supports my hypothesis, as 
English hashtags indeed dominate the international corpus, but not every second 
picture is accompanied by a non-English hashtag. 


3.3 Hypothesis 3: The most characteristic pattern of photo subtitles 
will be a connection of text and independent hashtags 


The most typical picture-text pattern is the following: the picture is followed by 
non-linked text which can be taken as a subtitle and then - as further textual 
content - the hashtags (Table 1). Subtitles can be a single word, a sentence, a 
poem, a quote, and sometimes, though relatively rarely, even a very long text. If 
the post is shared on Instagram, subtitles sometimes appear as hashtags. This 
may take the specific form that instead of a series of independent hashtags all 
syntactic units or all words of a phrase or sentence are marked with a # sign. 
Sometimes more important elements and keywords are emphasized as hashtags 
within the subtitle text (and this may be further combined with @ signs mark- 
ing persons). 


Table 1: Photo subtitling patterns on Instagram 


Pattern Examples 

no text, only image - 

only hashtags #awesome #time sunday #bff love music 
#followback #Delhi #sdamarket 

only non-linked text [No occurrence in the corpus, as only hashtagged 
pictures were collected. Still, there may be one example: 
Christmas] 


non-linked text + independent | Found this old photo from over 25 years ago. Scary 
hashtags (the most typical form) | how quickly time passes! #time #passingtime teenager 
#teenageyears 


hashtags within a text (keywords | Our latest #mashreads book selection is 

are emphasised by hashtagging) | #FatesandFuries by Lauren Groff, a love story told from 
two very disparate #perspectives. Based off of the themes 
of the #book, for this week’s MashReads social challenge, 
we want to see examples of juxtapositions you find 

in the wild such as light and dark or two contrasting 
textures. Be sure to tag your photos with #mashreads to 
enter. #NYC #PhotoChallenge (Image: @tylertronson) 
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Pattern Examples 

coherent text with hashtags + #cloudporn with #lighthouse at old #port of #Chania 
list of extra hashtags #Crete #Creta #Greece #travelgram #instatravel 
hashtagged words in #sweet #dream #my #time #crazy #time 

expressions, collocations 

each word in a text is #life #is #like #a #car #if *you #keep #going #in #reverse 
hashtagged #you #will #not get #to your #destination #but #if 


#you #speed #up #and #do #not #take #the #time #to 
#enjoy #your #surroundings #you #might #get #lost 


3.4 Hypothesis 4: The vast majority (90%) of the hashtags will fall 
into the thematising or like-hunter categories, while unique 
hashtags will represent only a small minority (1096). A large 
number of hashtags is expected to refer to the manner 
the photo was created 


Analysing the corpus, the originally planned three categories (thematising, like- 
hunter, unique hashtags) had to be completed with another three: hashtags in- 
dicating group identity, hashtags describing how the picture was created, and 
hashtags that did not fit into any category and were meaningless for outsiders 
without a context, though not necessarily containing unique words (e.g.: #N16, 
ftis, fand, #get). 

Thematising context-marker hashtags dominate the sample (83%). Similarly to 
posted pictures, these were characterised by seasonality: keywords like autumn, 
fall, halloween, pumpkin appeared in such high numbers as the sample was taken 
in late October. 

A user's popularity is measured with the number of its followers and thus the 
number of user interactions it can achieve. In the case of the Instagram profile of 
companies, products and brands, the large number of followers enhances the ef- 
ficiency of advertising and helps reaching the highest possible number of potential 
customers. For this reason, there were many (55 different types, 230 with repeti- 
tions) hashtags which encouraged following in several forms (e.g.: #followme, #fol- 
low, #follow4follow, #followback, #followmeplease). Similarly, hashtags encouraging 
users to like or share the post (#like, #likesplease, #likeitplease, #likeme, #likemy- 
photo; #pleaseshare) also aim to popularise the posted information reaching as 
many users as possible, and are often based on mutuality: like is offered for a like 
or a follower (#like4like, #likesforlikes, #likeforfollow). Hashtags reflecting on the 
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phenomenon of hashtagging can be taken as meta-hashtags.? Hashtags referring 
to joining to a community also serve the spreading of the content (e.g.: #poetry- 
community, #PoetsofInstagram; #instaitalia). 

Usually, unique hashtags are not only made of set phrases or collocations 
(#goodfood, #goodgirl, #goodlife, #goodvibes) but they are also created by writing 
a longer syntactic unit, even a full sentence, as one word. The sample comprised 
154 unique hashtags (e.g.: #gottadowhatyougottado, #StillAKidAtHeart, #tellme- 
whatyoudask, #whereisthebagelemoji). Although they are not totally unique, im- 
peratives and good advices constitute a separate group (e.g.: #thinkaboutit, #riseup, 
#neverstopexploring, #livethemoment). 

Meta-information about creating the pictures was expected to be much more 
dominant in the corpus: only 50 types (with 102 occurrences) were found in 
this category (e.g.: #vscocam, #photoshoot, #nofilter, #blackandwhite, canon; cf. 
Schrey 2015). 


3.5 Hypothesis 5: The examined pictures are expected to be mostly 
about people, followed by objects and animals in order. As a 
sub-hypothesis, selfies are expected to represent 20% of the 
pictures depicting people (cf. Wendt 2014) 


The biggest thematic group contained indeed photos of people (138 out of 400). 
Of this, 43 evidently or admittedly (according to the hashtags) qualifies as selfie. 
This rate, however, surpassed my expectations: 3196 of the pictures taken of people 
are self-portraits. Surprisingly though, only 11 of the 43 selfies reflected explicitly 
on the act of taking a selfie with the hashtag #selfie. 

The second largest group of pictures depicted objects (furniture, books, etc). 
Probably, the keyword £truth resulted in the high number of posts displaying 
texts (memes, quotes) as images. Further categories deal with food and beverage 
(often hashtagged as #foodie by analogy with selfie), nature, built environment 
and animals. Surprisingly, the traditional composition of a person posing with a 
famous touristic site in the background was quite rare in the sample (note that this 
would have been one of the most dominant composition if the keyword £travel 
or #travelgram had been used). 


5 An example: #lookatthecutekittenontherightalsoextralonghashtagsrule. 
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4. Conclusion 


I used three keywords matching the theme of the VLL conference to describe the 
relationship between pictures and hashtags, these new-type minimalistic texts 
which are similar to subtitles but have many different functions compared to 
them. Quantitative and qualitative analysis of small data was carried out to test 
the validity of five hypotheses. 

The first hypothesis, which expected to find many spelling variants and syno- 
nyms among the hashtag chains consisting of an average of eleven hashtags, was 
mainly confirmed: the pictures in the corpus were accompanied by an average 
of 12 hashtags, which however, indeed included synonymous words and mor- 
phological variants. The second hypothesis, which expected an overwhelming 
dominance of English hashtags, was clearly justified with a 9096 rate. The third 
hypothesis relied on previous observations when expecting that Instagram sub- 
titles mostly follow the pattern of “unlinked text + independent hashtags" The 
fourth hypothesis was based on the results of former hashtag analyses. Accord- 
ing to my results the three categories (thematising, like-hunter, unique hashtags) 
should be completed with at least three further categories (hashtags marking 
group identity, hashtags indicating how the picture was created and unclassifiable 
hashtags). The highest number of items belonged to the category of contextualis- 
ing hashtags which verbally represent the content of the photo, while technical 
meta-information relating to the taking of the photo was not so characteristic 
than it seemed to be prior to the analysis. The analysis of the fifth hypothesis 
applied a semiotic approach, focusing on the connection between the content of 
the photos and the accompanying hashtags. More than one third of the pictures 
depicted people, and of this, one third qualified as selfie though seldom indicating 
this fact with the #selfie hashtag. 

As it has been emphasized earlier, my results on frequency of occurrence are 
valid only to this corpus and were meant to complete the theme of the conference. 
However, hashtag types, subtitle patterns and the very strong co-occurrence of 
words having the same semantic field in a hashtag chain are results that can be 
generalised. Further examinations may deal with the co-occurrence of certain 
elements in hashtag chains from a semantic aspect and the grammatical analysis 
of neologisms and word formation methods in Instagram-related texts. 
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VISUALITY IN TEACHING AND LEARNING 


Matthew Crippen 


Dewey on Arts, Sciences and Greek Philosophy 


1. Introduction 


In this chapter, I ponder John Dewey’s efforts to understand science in terms of 
both the practical and fine arts; and how his writings on art and science suggest 
that Plato and Aristotle correctly identified conditions under which things become 
visible to cognition, even while not satisfactorily answering how these conditions 
can be met. Since Dewey understood aesthetic experience as a dramatic process, 
I also discuss how visual experience is imbued with narrative and therefore tem- 
poral structure, and the importance of this to understanding and learning. 


2. Intelligible Appearance, Modern Science and Art 


Dewey wrote that "[t]he doings and sufferings that form experience are, in de- 
gree to which experience is intelligent or charged with meanings, a union of the 
precarious, novel, irregular with the settled, assured and uniform - a union,’ he 
added, “which also defines the artistic and esthetic" (1925: 358). "Doings" here 
meant actions carried out; “sufferings; the effects undergone in consequence. Thus 
a blind woman pushing her cane into the world meets non-haphazard resistance 
and thereby undergoes meaningful consequences of her actions, and perceptual 
experience of the world emerges. By emphasizing the union between the novel 
and assured, Dewey further stressed that experience is pallid and thin when there 
is little free play; but simultaneously that meaningful connections are lacking 
when actions are unvarying and mechanical, so that things lose significance and 
withdraw from notice. 

For Dewey, the conditions under which we have meaningful experience are 
also conditions under which “we become capable of perceiving things instead of 
merely feeling and having them" (1925: 182). The distinction might be compared 
to the difference between seeing a candle flame as a candle flame and merely being 
aware of a fluttering smear. In the first instance, we do not merely register qualia; 
we discern what the thing is; and in traditional philosophical parlance discerning 
the “what is" means discerning "essence" It will be recalled that eidos - usually 
translated as form and occasionally as essence - is a Greek word that “basically 
means something that is seen” (Novak 2004: 77). It is a word, moreover, that Plato 
poetically and brilliantly used to signify that which allows the “being” or “what is” 
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of a thing to appear to the knowing mind. Brilliantly does not mean unproblem- 
atically, however; but while Platos concept of eidos entails a theory of knowledge 
Dewey criticized, he was not unsympathetic to classical Greek outlooks. In fact, 
Dewey favored concepts of experience articulated by Plato and Aristotle, albeit 
giving experience more value than his predecessors. He retained the classical op- 
position to nominalism, though did so in non-classical ways - a point addressed 
later. He also seems to have accepted the classical view that things can only ap- 
pear intelligibly if the following criteria are met: There must be structure, unity 
and endurance. 

Dewey’s discussions of experience - particularly aesthetic experience - illus- 
trate this last point. They do so by showing experience and therewith intelligible 
appearance - which Platos concept of eidos equates to form - emerge when doings 
and undergoings are linked in worldly action, integrating in much the same way 
incidents in a story cohere into a single, narrative structure that endures over time. 
Thus a focal point in a painting pulls other elements into a more coherent unity; 
and when we reach the climax of a play, earlier portions unite and gain significance 
in comparable ways. By virtue of this, constituents in things experienced aestheti- 
cally do not appear as isolated, fleeting bits, here now, gone an instant later. They 
gain stability within a temporally extended and integrated narrative-like structure. 

Dewey gave the following example. Imagine a painting “in which masses point 
upward”. A “first impression” may be “that of movement from below to above”. If 
the painting has horizontal rhythms, our eyes are also drawn “across the picture,” 
even while “the intensity remains in patterns that rise”. Suppose further that a 
heavy mass dominates a lower corner, and “that instead of fitting into the vertical 
patterns,” this mass “transfers attention to [...] horizontally disposed” features in 
the composition. When our eyes meet it, “there is a halt, an arrest, a punctuating 
pause”. However, this does not “operate as a disturbing interruption” or “break in 
experience, but rather “as a re-direction of interest and attention” and therewith 
an “expanding [of] the significance of the object” (Dewey 1934: 174). If the experi- 
ence is truly aesthetic, moreover, it will be one that pulls the capacities of our body 
into unity. Here, wrote Dewey, a “tendency to turn the eyes and head is absorbed 
into a multitude of other impulses”; and while “the eye is primarily active, [...] 
the color quality is affected by qualities of other senses overtly active in earlier 
experience” (1935: 175), so that we can “perceive, by means of the eyes as causal 
aids, the liquidity of water, the coldness of ice, the solidity of rocks” (1934: 123). 
Thus the painting appears unified because of the way it coordinates our sensi- 
tivities and doings, so that they “become members of a single act” (1935: 256; for 
review, also see Crippen 2014 and 2016). 
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The unity of the painting also emerges because the pattern of activity it brings 
about has dramatic pauses, culminations and more. Aesthetic experience is ac- 
cordingly temporally extended and narrative-like, and interestingly, it satisfies 
the earlier mentioned classical criteria for intelligible appearance. However, while 
sharing the classical view that structure, unity and endurance are pre-conditions 
of things appearing to us, Dewey did not equate unity to universals binding the 
many into one, nor endurance to immutability. Instead, change, irregularity and 
instability help bring unity, structure and endurance. Hence a movie endures as 
a unity largely because of the way it changes and builds, whereas mechanical and 
unchanging intervals tend to lose significance, coherence and withdraw from 
notice. Paintings are similar. 

By emphasizing change as a precondition of things appearing intelligibly, 
Dewey shifted away from the traditional Western philosophical view that the in- 
telligible and therewith the knowable are beyond change. Some might be inclined 
to ask "So what?” on the grounds Modern era science has done the same. Yet this 
conclusion is somewhat misplaced. After all, Isaac Newton advanced laws meant 
to hold across time and place - laws, therefore, that are immutable and universal. 
Furthermore, though Newton partly derived his laws from observation, they do 
not exactly describe motions we could perceive through the senses. Instead, they 
capture how planets would theoretically move if they were point-like objects, 
which is to say, under ideal conditions never observed. Newton thus described 
physical reality in terms of immutable and universal patterns only realizable under 
ideal conditions in which all materiality is subtracted away - conditions, therefore, 
never actualized. Other physicists have done similarly, with Galileo deriving kin- 
ematic laws by first observing rolling marbles, and then imagining their motion 
on non-existent frictionless surfaces, which recalls Aristotles observation that 
inquiries cease to deal with material nature and consequently to be natural science 
to the extent they become mathematical.! 

Atthe same time, the Modern emphasis on experimental science has given cre- 
dence to the view that we come to know reality by actively manipulating it. Dewey 
argued, in particular, that this involves an adjustment to the classical tendency 
to think tekhné a lesser form of knowledge than theoria, that is, theoretical or 
contemplative knowledge. In the texts of Plato and Aristotle, tekhné encompasses 
everything from statecraft to the medical arts to the art of war, calculating, ship pi- 
loting, playing musical instruments, painting, making shoes and managing money. 


1 For elaboration, see Book I, lesson 9 in Thomas Aquinass Commentary on Aristotle's 
Metaphysics. 
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It entails knowledge about certain kinds of objects, but these objects of knowledge 
are not objectives at which it ultimately aims (see Aristotle Eud: 1216b16-18; Phys: 
193b10-20). Awls, leather and even shoes are objects of knowledge for the shoe- 
maker, but the objective of the shoemaker's art is not to know what these things 
fundamentally are, but rather to know how to work available materials into shoes. 

According to Dewey, the rise of Modern science entailed “a generalized [...] 
adoption of the point of view of the useful arts" (1925: 133) and therewith a reor- 
dering of classical Greek values. An initial point to remember is that "science" - 
from Latin scientia for "knowledge" - traditionally refers to any organized field of 
knowledge. Traditionally, moreover, it has designated fields of inquiry held in high 
esteem. Hence when Christianity became dominant, Christian theology became 
a science. Then, when systematic observation and experimental study of material 
nature became a preferred approach, it was designated as science. So if modern 
science adopts the point of view of the useful arts, it follows that reverence for 
tekhné has grown - and today many do esteem technology (i.e., useful arts). Dewey 
suggested, however, that we express esteem more in deeds than words, for we often 
classify disciplines as "scientific" with the intention of distinguishing them from 
arts. Dewey obviously thought this distinction overdrawn, and offered a number 
of reasons for thinking so. 

First, scientific observation is carried out with the aid of instruments or tools 
by means of which we work upon things; and when workings are skillful, im- 
aginative and intelligent, directed towards an end and efficacious at producing 
some result, they fall within the scope of what we call “art”. Dewey explained that 
scientists study an object by bringing "some energy to bear upon [it] to see how 
it reacts" (1920: 113) or by “deliberately alter[ing] the conditions under which 
we observe [it]" (1929: 85), as when using a telescope to redirect light. Aristotle 
characterized art as a kind of applied knowing that works in the "sphere of com- 
ing to be" (An. Post.: 10049), and contemporary scientists, through application of 
art, introduce "changes which will elicit some previously unperceived qualities" 
(Dewey 1929: 87). 

Second, scientists do not typically build or learn theories with the final objective 
of securing them as objects of knowledge. Rather, their objective is securing means 
through which observable phenomena can be rendered intelligible. Thus whereas 
knowledge of Platonic forms - assuming, for a moment, that forms have being - is 
knowledge of reality, knowledge of scientific theories is possession of instruments 
that work to make reality knowable or at least intelligible (Dewey 1929: 205-206). So 
while it is perhaps going too far to equate scientific theories, say, to the shoemaker's 
knowledge of leather, the two share an important commonality: both are used for 


Dewey on Arts, Sciences and Greek Philosophy 157 


working and making. The shoemaker's knowledge is applied to the making of shoes; 
scientific theories as sense-making instruments; and neither are complete until 
they work upon and re-form materials, thereby making them appear in new ways. 

Scientific theories, moreover, structure how scientists directly and indirectly 
work upon objects of investigation and thereby "shake loose" heretofore "unper- 
ceived qualities" (Dewey 1929: 87). In addition to and by virtue of structuring 
hands-on work, theories also structure how scientists make objects - both concep- 
tual and physical - relate. Therewith they structure how given fields of inquiry knit 
together into coherent worldviews or narratives. The Copernican theory that the 
Sun is at rest literally changes how we must picture relationships between celestial 
objects if we are to picture them coherently at all. The point is that scientific theo- 
ries - however they may arise - perform work; they perform what Dewey called 
"the work of art" (1934: 214). In the case of fine arts, this ^work takes place when 
a human being cooperates with [an artistic object ...] so that the outcome is an 
experience that is enjoyed because of its liberating and ordered properties" (1934: 
214). And with scientific theories, the work takes place when actions, incidents and 
objects coordinate into instrumental, which is to say, integral and hence meaning- 
ful relationships, so that orderly arrangements cohere intelligibly into appearance. 

Dewey believed his understanding of knowledge as art was anti-skeptical in 
the sense that it “does not commit us to the notion that classes are [...] purely 
mental" or ^merely nominal" (1920: 154). It does not because "knowing" means 
making “a certain difference in reality" (Dewey 1908: 47) and conceptual classes 
are realized in "objective action" (Dewey 1920: 154). The general distinction, for 
example, between hard and softwood is realized in how carpenters generally work 
and build with lumber. Very literally, therefore, the distinction is based in human 
constructions. Yet we do not designate houses and other constructed entities as 
figments of imagination, so Dewey warned against rejecting conceptual distinc- 
tions as such simply because they reflect worldly arrangements we help build 
(1925: 181-191). Like artists, we confer “upon things traits [...] which did not 
previously belong to them? Complaints that this makes knowledge a “perversion” 
reflects "a confusion of tenses. Knowledge is not a distortion [...] which confers 
upon its subject-matter traits which do not belong to it, but is an act which confers 
upon non-cognitive material traits which did not belong to it" (Dewey 1925: 381). 


3. Implications on Teaching 


So how might all this translate into classroom practices? To begin with, the forgo- 
ing account reaffirms that things are not visible to the knowing mind if there is no 
unity, endurance and structure. In contrast to older views, however, it also suggests 
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things only take such form if there is change, yet artful and not just random vari- 
ation. In line with more recent approaches, therefore, it affirms that knowledge 
involves mucking around. By means of this, we change the world and produce 
outcomes that change us. Thereby we learn. The imaginative experimentations 
of impressionist painters, for example, open us to seeing light in new ways, and 
something analogous occurs in experimental science. 

Interpreting this mucking about into what counts as knowledge means, in ef- 
fect, arranging it into dramatic form. This point is illustrated in the earlier example 
of the painting. But likewise, when students engage in learning by doing, whether 
they are putting car engines together or doing scientific experiments, comparable 
effects are achieved. Making sense of an experiment means telling a story, and 
putting an engine together or even learning how it is put together can be expe- 
rienced as a story. This view, which is typified in Dewey's claim that science and 
knowledge are art, resonates with the prevailing view that we learn more from 
doing than mere listening or reading (Sousa 2006: 95). 

Regarding images and visual learning, Dewey's account offers a viewpoint that 
has received relatively little attention: namely, that pictures, when they engage us 
in a relatively full manner, do not merely operate on a purely cognitive or men- 
tal level, but engage a variety perceptual faculties, along with motor capacities. 
I therefore conclude with a plea: that when pondering visual aspects of learning, 
we consider how images can motivate a total body process. That is, we ought to 
consider how the visual is never merely visual, how it not only mobilizes other 
perceptual faculties but movements too; and how, by developing visual tools along 
such lines, we might become better teachers. 
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András Benedek 


SysBook as a Visual Learning Frame 


Thinking with pictures is an essential strand in the 
intellectual history of technological development. 


(Ferguson 1977: 827) 


1. Introduction 


This chapter points out that measurable learning activities show time-dependent 
features that correlate with the use of visual communication forms used in study 
programs. This chapter also presents the basic principles of systems and control 
for everyone, hopefully in an understandable way and also with deeper explana- 
tions and a mathematical description. According to the author's hypothesis, visual 
learning carries the possibility of such parables that will be able to improve the 
efficiency of human learning, currently characterised by a constant lack of time 
and information pressure. SysBook, as opposed to a traditional education based 
on verbal communication (Vamos-Bars-Benedek 2015: 7), is software that links 
visual content related to a given subject to traditional written information, very 
much the way comics work. At the same time, it also addresses the given subject 
in the language of mathematics and recommends references for those who seek 
further information. In this way, students learning from a particular document 
while processing its content become actively involved, and the curriculum may 
be continuously updated and extended. All this is realised in a modern, accessible, 
online framework. 


2. Theoretical Background 


The process that resulted in historic changes in education may be viewed from 
several aspects. One of these may be approaching the process from the direction of 
changes in content and the applied tools of demonstration. In this single field only, 
a large and diverse group of didactics experts and theorists developed numerous 
theories on how to teach more and increase the efficiency of teaching. Ferguson's 
paper The Minds Eye: Nonverbal Thought in Technology (Ferguson 1977: 827-836) 
almost forty years ago pointed out how poorly our current education paradigm is 
able to exploit the potential of visual learning. The art interpretations of learning 
make us abandon older teaching traditions when designing new curricula in a 
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digital environment, providing learners with a flexible, continuously developing 
curriculum. Higher education has always been a unique laboratory for education- 
related innovations, concentrating significant research and development poten- 
tials with excellent subjects for experiments aiming at modernising education, 
i.e. students. In the past 25 years, several theorists pointed out that increasing 
curricular requirements cannot be efficiently managed by formal education and 
the traditional tools of education should be modernised. The rapid penetration of 
ICT tools since the second millennium in particular presents a challenge regard- 
ing the practice and methods of education (just consider mobile communications, 
hybrid solutions in smartphones, multiple functions or apps). Hence, we selected 
the new possibilities of visual learning as a subject of our research, responding 
to the main trends of these changes. In addition to theoretical research, our work 
also included innovative didactic development aiming at creating a new system 
of teaching of increased complexity, regarding both the activation of students 
and the development of curricula. Keywords in the process include increasing 
the number and quality of visual elements, exploiting the potentials of the new 
technology and thus increasing the activity of students. 

An important preliminary aspect of our research was the realisation that both 
learning and the teaching process have become increasingly open systems. This 
openness is partly the result of a change of paradigm, and partly the application 
of ICT tools themselves, that have rendered learning a form of communication 
no longer dependent on either space or time constraints. Learning in this latter 
sense is about information that is no longer characterised by closed text blocks, but 
images and other elements presented in particular selection algorithms. This pro- 
cess was recognised by philosophers as early as the turn of the 20th century, and 
interpreted as a return to the origins of visual communication. In this sense, the 
natural way of communication between human beings relies on the application of 
images, icons or comics where film clips represent an interesting manifestation of 
unique, relatively short narrations (they quickly penetrated the world of teenagers 
in the past decade in the form of television advertisements and YouTube clips). 

At the turn of the millennium, because of mobile technologies, we are mov- 
ing fast from the appearance of human-machine interactive communication to 
the formation of spatial independence of human communicational possibilities. 
These two landmarks imply new pedagogic challenges figuratively also symbol- 
ize thresholds, one of which we have already crossed, and we hesitate to cross 
the other, from which we are faced with an ever complex transformation of the 
world of education. Our traditional approach to classroom teaching and learn- 
ing has fundamentally changed in the last decade with the possibility that visual 
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aids - overhead projectors or video projectors - have became virtualized, made 
in ‘real-time’ by broadband data transmission without physical presence. 

A series of new frameworks have appeared in learning (digital environment) 
and the relevant new approaches are being formed currently. In his essay Open 
Work (Opera aperta, 1962) Eco, a half century ago, discussed the aesthetic proper- 
ties of “open work” as essentially ambiguous, offering a range of potential mean- 
ings, where the author offers the interpreter, the performer, the addressee a work 
to be completed' (Eco 1989: 8-9) and it all became real. Today's modern e-learning 
curricula (OER - Open Education Resources) try to find the answer to the ques- 
tion how the curriculum can be “opened” and the knowledge transferred to stu- 
dents in an open structure. Nyíri took a particularly inspiring role in finding such 
answers (Nyíri 2003, 2012, 2014). Joining his work and in the very framework of 
the VLL workshop and conferences, I decided to examine the questions related to 
educational construction (Benedek 2014, 2015). It is important to emphasise the 
joint thinking process here, as several major higher education institutions all over 
the world separate the dimensions of this problem and tackle them individually. 
Initiatives related to research on education theory were turned into experiments in 
the past decade with important practical relevancies. Such practical results include 
the expressed involvement of the representatives of connectivism, promoting 
initially the openness of higher education (Siemens 2005) and the penetration 
of MOOC (Massive Open Online Courses) in rank-leading higher education 
institutions. The development and dissemination of open educational structures 
have become priority topics (Molnár 2014). 


3. From Theory to the Practice 


In 2013 and 2014,29 digital textbooks were developed at the Budapest University 
of Technology and Economics in the framework of a new curriculum develop- 
ment project (Benedek-Molnár 2014: 3646-3650). Their authors, distinguished 
experts of their respective fields, were requested to participate in a training ses- 
sion where they were expressly asked to include visual objects in the content, 
corresponding to the principles of modern OER (Open Education Resources) 
development. Analysing 10 randomly selected examples of the textbooks with 
different professional content, but essentially made for the training of vocational 
teachers, we could conclude that the textbooks, 90 pages long on average and 
optimised for a screen, included altogether 602 images (figures, photos, tables). 
It means that even in the newest textbooks that support online learning, there 
is one image for every 1.5 pages on average only. From these, tables and figures 
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(drawings) represented 4296 and 3696, respectively, and only 2296 (one-fifth of the 
visual content) were photos. 

Improving the efficiency of an education system predominantly relying on 
verbal content may represent a significant challenge due to the lack of the neces- 
sary time and information and the slowness of correction mechanisms in the case 
of traditional curricula, as it was proved by several methodology experiments as 
cooperative methods, project-based work, and connectivism (Siemens 2005) in 
learning. Even “modern” curricula that had been developed by the end of the 20th 
century had a linear structure and the prevailing dominance of verbal content 
(8096 on average) was changing only slowly, giving way to visual content which 
in turn were mostly composed of static pictures. 

In the first semester of the study year 2015/2016, we directly surveyed our 
postgraduate students who studied for a second-degree about the learning frame- 
works facilitated by ICT tools. We presumed that cooperative networking activities 
well matched the life of students as well as their everyday ICT use. We surveyed 
students specialised at teaching as they were presumed to be interested both in 
teaching and learning. The survey also included questions related to the use of 
visual content. Conventional learning and preparing for classes often necessitates 
the processing or development of visual content, including learning aids and dem- 
onstration materials. Although students specialised at teaching received support 
in the form of online content and e-learning programmes, we also phrased direct 
questions about the framework system (Moodle) that has been applied for almost 
a decade. 

The survey included altogether 27 questions; most of these could be answered 
on a 5-point scale. They tackled the attitude of the users of e-learning curricula. 
The survey was sent to 150 students from which 115 responded. The sample may 
be described as follows: respondents were both males and females, 56 and 59 per- 
sons, respectively; the age of respondents approached normal distribution: 2896 
between 31 and 40 years old, 4096 between 41 and 50 years old and 2896 between 
5] and 60 years old. 

To the question “How efficiently can you learn from the e-learning curriculum 
regarding didactics and methodology*?" students’ responses were essentially posi- 
tive. Those who were fully satisfied with these curricula made up for 20.496. More 
than half of the respondents, 54.996 ranked these curricula as good' while 21.296 
considered them being of medium quality: Only 2.796 indicated dissatisfaction. 

As for the active contribution of students to curriculum development, the 
preference of students regarding visual content was particularly important. To 
the question *Would you consider it useful if case studies (descriptions of good 
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practices) were developed in this framework?" almost two-thirds of the respond- 
ents (61.796) fully agreed and no rejections were received. Considering all this, we 
created a new learning content net with the following features: 


Figure 1: The schema of complex learning content net 
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This program had methodological questions in mind, with special regard to math- 
ematics and other disciplines of natural sciences and the related applied sciences 
such as technical sciences and their applications. The schema of the complex 
learning content net (Figure 1) shows how the curricula are based on descriptive 
verbal elements (Text - t) that are supported by visual elements (Visual - V) and 
mathematical formulas (Math - M). Traditional curricula (published in the format 
of textbooks) usually include the combination of these, structured in a rigid linear 
sequence, such as explanation, figures, formulation, explanation and so on. Often 
random examples are only given as case studies (Case - C) to illustrate practical 
applications. The visual representation illustrates the most important features of 
the structure as knowledge elements are organised into a system, which is inde- 
pendent of scale. For curriculum design developed in open access, cloud services 
offer a development infrastructure surpassing all previous solutions. Showing 
other connections between these elements in order to develop a dynamic network 
was typically hindered by disciplinary and temporal restrictions knowledge on 
systems. 

This new curriculum was supported by e-learning, i.e. a digital textbook was 
available for students in the MOODLE (Modular Object-Oriented Learning En- 
vironment) framework system as a form of permanent support. Also we used the 
SysBook platform (W1), mentioned previously, which combines general knowl- 
edge with applications, thus creating a framework where textual information, 
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static comics elements, animated GIFs (Graphics Interchange Format) and, in 
several cases, elements of mathematical representation (formulas, functions) to- 
gether form a knowledge space that can be extended as needed. 


4. Forward to the New Content Development 


Our survey indicated that creative tasks and the possibility of the complex use of 
visual elements match the ideas of students about e-learning content. This new 
curriculum, where verbal and visual elements are presented in a one-to-one ratio, 
and where knowledge elements are organized into a network, would be scale-inde- 
pendent and structured as a graph. It would also be supported by a mathematical 
representation to enhance both its theoretical and practical aspects, and users 
would be allowed to extend it by means of case studies and practical examples. 

The e-learning textbook was created in the fall semester in 2015 by the cur- 
riculum developers (subject: Systems in Vocational Education) with the SysBook 
platform assisting those who were interested. We asked the students to make "case 
studies" as micro-content, with the compulsory inclusion of visual elements. These 
case studies had to be optimised for a screen (laptop, smartphone, etc.) according 
to the rules applying to micro-content, include visual content that describe the 
operation of the system and, if possible, also include a mathematical formula for 
the same purpose. 


Figure 2: Illustration from SysBook - Probability frequency 


(source: W2) 
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The SysBook gives the students a peculiar structure. Each one of the almost 140 
sections is customised for digital screens and each one is constructed to represent 
six levels of interpretation (Comics - Description - Maths - Example - Theoreti- 
cal - Education). The content is presented in quantified units which the reader can 
read linearly but because of the levels of interpretation mentioned above, each unit 
offers a range of possibilities to get familiar with a particular topic and examine 
it from various aspects. As a result of its structural features, SysBook takes the 
middle ground between modern hypertexts and traditional books. 

Most students proved to be extremely creative when completing this task. For 
illustration, we selected the picture explaining free fall, a perfect example of how 
well such a relatively complex phenomenon can be illustrated, explained and 
understood this way. 


Figure 3: Free fall 


(source: part of a students work; author: Tibor Tóth, Budapest University of Technology and 
Economics, 2015) 


Such case studies that use strong visual elements and apply these for the purposes 
of orientation can be prepared by the students when given as a task. Explanations 
and the editing work may be considered themselves as educational constructions 
and thus, the preparation of the case studies is viewed as a unique way of col- 
laborative learning. 

It is also obvious, however, that the network environment defined by the ap- 
plied technologies and virtual reality that breaks down the spatial and temporal 
limits of social interactions both symbolically and physically have an increasingly 
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important role in shaping the social environment of learning. We may consider 
it a major trend. For those committed to modernising education, the possibility 
of learning systems divided in time and space may be a good basis for innova- 
tion, while the same fills the advocates of conventional education with terror. 
Although the virtual learning environment offers several options to modernise 
teaching methods, major projects in this field are less typical in Hungary than 
social initiatives illustrating the key idea of the change. In this initial phase of 
our research, we can phrase a few hypotheses that should be verified empirically 
in the years to come, by means of research that should involve other disciplines 
(psychology, informatics, physiology) in addition to pedagogy. Focusing on key 
aspects, the conscious strengthening of the role of visual learning may yield the 
following results: 

A chance for collaborative development where the construction of micro- 
content by students and teachers facilitates a strong and efficient horizontal com- 
munication to replace the conventional vertical communication, and thinking 
outside the box of formal education which is limited both in space and time. 


5. Conclusions 


Open online content can be considered as the key results of innovation. The new 
ICT environment and the applied technical tools guarantee the essential openness 
of these contents. This unique feature clearly distinguishes the content from the 
strictly controlled and closed system of conventional curricula; however, obtain- 
ing experiential knowledge in the process of collaborative creation significantly 
reduces the risk of using unverified elements when the common knowledge base 
is extended. 


e Continuous synchronisation. While it is apparently a technical aspect only, it 
has a great significance in relation to the features described above. Creation, 
even at the level of elements, may be evaluated (validated and approved) in 
well-defined phases. Although the medium is developed in the specific social 
dimensions of the learning environment, it is important to know which one of 
the many phases the process has reached at any given moment. This is facili- 
tated by continuous synchronisation, a feature that is also linked to the next 
one. 

e Automatic updating, an important process to follow various changes in the 
knowledge elements and the differences between sources. Updating in the cur- 
rent phase of research is much simpler in the framework provided by modern 
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IT infrastructure than in the restricted and formal system of public education, 
in the practice of higher education in particular. 

e Content sharing and data security are also features considered important in 
our experimental teaching environment. Of course, we also had to take into 
account the possibility that students would submit ideas for image content that 
represent a serious technical challenge to the traditional educational infrastruc- 
ture. However, the latest ICT developments offered solutions to this problem, 
also directing our attention to a unique feature: 

e Unlimited memory - cloud services. Their advantages were first experienced by 
researchers in high-tech subjects who needed superior infrastructure for their 
work but cloud services, like so many other technical innovations, have already 
started to penetrate the daily operation of education. The most important result 
here is that the restrictions forced by traditional technologies (allowed number 
of characters, pages, etc. in the curricula) can be now eliminated, hence im- 
ages will cease to be a "necessary evil”. Cloud services make it possible to in- 
clude more visual content, resulting in an increasingly complex representation 
of knowledge. It does not only diversify demonstration possibilities but also 
changes learning communication, putting more emphasis on visual elements: 

e A new creative learning environment is being/may be created. Whether the 
present continuous tense indeed applies or we are only talking about some 
obscure possibility will be decided by the results of the coming years. 
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Micro-content Generation Framework 
as a Learning Innovation 


1. Introduction 


Young people today have established a new content consumption culture by the 
active, everyday use of content sharing sites. The time dedicated to particular 
content items has decreased, while the number of texts, images or other media 
items viewed in a given unit of time has increased. Technology poses no limit to 
"information gluttony": state of-the-art Web 2.0 technologies facilitate connec- 
tion to a continuous news feed. The basic economic principles also work here, 
however, as the value of ample resources is low. To compensate for the inflation of 
information value, an experiment was initiated to examine the potential of micro- 
content to add value to education. Micro-content generated for the purposes of 
higher education are well structured, have limited volume and can be managed 
as units, while the validity of the information contained therein is guaranteed by 
the involvement of named authors, feedback by the community and proofreading 
provided by teachers. In this paper we discuss the latest phase of a work process 
started earlier to renew micro-content. Using software that operates in a Web 
2.0 environment, participants can create and publish their own micro-content 
collections. Each micro-content receives a unique identifier and authors' data are 
preserved, facilitating the free copying of collections and their components into 
other micro-content collections. I offer the conclusion that in using this method, 
student communities may create their own knowledge assets on their own merits, 
which in turn lead to better learning results. 


2. The Early History of Micro-Content 


Micro-content (Lindner-Hug 2006; Lindner 2007), as their name suggests, are 
created to convey information in the most compact form possible (Nyíri 2010). 
Text-based micro-content are characterised by a concise, straightforward style and 
a complete lack of “verbal fluff”. One of their important features is the low cogni- 
tive load associated with obtaining and understanding a given unit of information, 
compared to other media such as news, novels, radio interviews, etc. 
Micro-content cannot be strictly defined according to their size only, as size 
may depend on time, location and application, or the relevant agreement within 
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a group of users. The tool used to transfer the content also influences the size and 
quality of content. Conventional postcards, for example, could only convey mes- 
sages limited in size, representing an early form of micro-content. 

The short message service, still popular today, limits messages to 160 charac- 
ters. We might think that this limit was due to technological limitations at the 
time when the GSM telephone system was being standardised in the 1980s, but 
actually, if the related press information is to be trusted (W1; W2), it was based 
on the decision of a single person. Twitter was supposed to be the short mes- 
sage supplier of the Internet, initially allowing 140 characters for a user message. 
However, Twitter policy has radically changed since then (W3), and unlimited 
messages can be now accompanied by pictures, too. Hence, this representative of 
micro-content has ceased to exist. 

A message may not only be defined as micro-content using the number of its 
written characters. Snapchat allows a maximum of 10 seconds for viewing an 
image or video sent by a user, and you cannot replay it. In this case, users should 
phrase straightforward messages that can be perceived and understood in the 
given time frame. 

Magyar Virtuális Enciklopédia (Hungarian Virtual Encyclopedia; W4) was 
developed relying on the micro-content approach, supervised by Kristóf Nyíri. Its 
fifteen hundred entries, of an average length of 1400 characters each, were written 
by acknowledged experts and they are heavily interlinked. Entries are concise, yet 
they are efficient in informing the reader about scientific achievements in several 
fields (e.g. law, environment, EU, learning, health, etc.) 

At the Visual Learning Lab (VLL) of Budapest University of Technology and 
Economics, Kristóf Nyíri and András Benedek supervise the work of research 
teams that focus their efforts on the modern-time exploitation of visual commu- 
nication with special regard to everyday teaching processes in higher education. 
Research also includes micro-content. 

Another good example of practical micro-content applications is SysBook, 
developed by Tibor Vámos and his team. At the moment, SysBook can display 
140 content units optimised specifically for small screens. Though these content 
units essentially form a sequence, there are six interpretation levels associated 
with each unit (image, text, mathematical demonstration, demonstrations from 
everyday life, theory, and education). These interpretation levels may be displayed 
together, facilitating comparison. 

I wish to discuss here two earlier experiments of mine related to the use of 
micro-content in education. The first one is an early, yet fully operational micro- 
content editing system that was used by the students involved in the experiment 


Micro-content Generation Framework as a Learning Innovation 173 


to generate compacted visual and textual content in fields they were interested in. 
These were saved on a computer by means of a browser software (maximum width 
of images: 300 pixels; maximum number of characters for texts: 1024). Students 
were expected to generate blocks of content that can be interpreted individu- 
ally while also forming a coherent description of a given topic. The figure below 
illustrates a few solutions from the several hundred we received: 


Figure 1: An early micro-content editing system 
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(source: students’ projects, Budapest University of Technology and Economics; authors: János Horváth 
Cz., Akos Czurkó, no author indicated [W5], Balázs Brosch, Boglárka Szili) 
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In our next experiment, we developed a system to display student activity as 
micro-content, based on colour codes, in the framework of Moodle (a course 
management system used by the Department of Technical Education): 


Figure 2: A micro-content experiment, based on colour codes 
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(source: Moodle, Budapest University of Technology and Economics; screenshot taken by the author) 


In Figure 2, each square represents a student in the Moodle system. The colour of 
a square corresponds to the time interval between the “present” as represented by 
the date of the survey and the last time the student was active in Moodle. Green 
squares mark currently active users while the colour red means the last time a 
given user logged in was rather long ago. The hues between these two extremities 
represent intermediate intervals. In this experiment, we looked for a way to display 
a relatively large number of states on a limited screen. As the figure illustrates, 
colour codes represented an ideal solution. 


3. Typical Contemporary Ways of Content Use 


Since these experiments, technical conditions have changed a lot and fast. While 
users’ screen size, computing performance and the speed of data transfer used to 
be important limiting factors that rendered the compaction of information una- 
voidable, these limitations are no longer relevant. Currently used mobile devices, 
while being much smaller than PCs used to be just a few years ago, have much 
better performance parameters than those. Improved performance has led to 
changes in user behaviour. 
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According to the relevant references (Tórócsik 2013; Carr 2010; Howe-Strauss 
2000; Ollé et al. 2013), the group born between 1995 and 2005 (known as Gen- 
eration Z) is different from older generations in several aspects. One of their 
distinguishing characteristics is their taking the Internet as a readily available 
resource. Accordingly, Generation Z considers connection to the network essen- 
tial and promptness has become a more or less basic requirement. Generation Z 
people prefer being preoccupied with many things; however, they are not able to 
devote much time to a particular topic. This behaviour, also known as multitask- 
ing, presumes the division of attention; however, its efficiency is dubious. These 
people search for information all the time and become frustrated if this demand 
of theirs cannot be satiated. Although they continuously hunt for new bits of 
information, organising these into some mental framework may often represent 
quite a challenge for them. 

In his book, Nicholas Carr (2010) details the way various devices providing 
access to information can change the mental processes of users, sometimes in a 
really short time, including changes caused by Internet use. This uniqueness of 
Generation Z gives rise to the question whether there is a device that can be used 
both by them and the older generations. 


4. Micro-content Organised into a System 


In the previous sections we discussed the unique ways Generation Z approaches 
the processing of information. At our department, we educate the experts of the 
future who will have to work with this generation of students as relatively old 
teachers. Our students, specialised in the teaching of a particular course, experi- 
ence difficulties when trying to understand young people, so it is a challenge to 
organise lessons that can grab their attention and facilitate efficient teaching. 

We realised that information management based on micro-content is a good 
way to practice “tuning in to Generation Z” To support this “tuning,” we developed 
the Web 2.0 version of the micro-content editing system, under the name MEdit. 
MEdit facilitates the generation, limitless storage, thematic organising and sharing 
of compact content. Our goal was to facilitate easy and prompt use, both when 
generating and receiving content, reducing the burden related to the application 
of this information, known as cognitive load. 
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Figure 3: Examples of image and text based micro-content in the MEdit system 
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(source: MEdit; screenshots taken by the author) 


Figure 3 shows examples of image and text based micro-content units. We should 
note here that micro-content units always have their own names, information 
about the author is always maintained and content may also be labelled. 


Figure 4: Mass preview of micro-content 
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(source: MEdit; screenshot taken by the author) 


Figure 4 provides a preview of micro-content uploaded into the MEdit system. 
When clicking on any given compact unit, its actual content can be viewed. Com- 
pact units containing images have a stamp-like preview. In the case of text based 
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units, however, the preview gives a colour combination generated by a method 
developed by ourselves, thus facilitating distinction. 


Figure 5: Creating a thematic collection of micro-content 
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(source: MEdit; screenshot taken by the author) 


Micro-content units may be organised into thematic collections as illustrated by 
Figure 5.In this case, users may organise their own compact units in a table, using 
its cells. Compact units may be moved between cells or deleted. 

Students participating in the trial runs needed some time to get used to the 
interface and to learn to appreciate the system. Once the first, well edited micro- 
content units had been uploaded, the majority followed the good example and 
started to develop their own compact units and then organise these into thematic 
collections. Most students processed their latest reading experiences, organising 
the content of rather long books into five to 10 micro-content units, thus ena- 
bling others to decide whether a particular book is worth reading or not. Some 
students prepared collections in their own professional fields, processing content 
related to topics such as boilers for domestic heating systems or raw materials 
for manufacturing wood products. Topics related to recreation and hobbies were 
also represented (e.g. Hungarian dog breeds, fish species for fishing, descriptions 
of ones home town, etc.). All in all, a very diverse and valuable set of data was 
generated in the trial period. 
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5. Future Work 


The MEdit system is developed continuously, with new abilities added to it every 
now and then. An important improvement promoting daily use is supporting 
the use of units using content other than image or text (audio, video or binary 
records). Providing opportunities for users to evaluate content is an adaptation 
of the practice of social evaluation and, as users are free to comment on content, 
we expect a boost in communication between them. 

Once a critical number of users has been reached, the volume of uploaded 
content is expected to soar. We consider the use of data mining tools an exciting 
option to form an increasingly accurate picture on the information recorded in 
the MEdit system and its changes. 

The micro-content based processing of certain subjects of courses organised 
by our department is a novel didactic experiment. Is it possible to compact high 
volume curricula written according to conventional principles into micro-content 
units? How can the author cooperate with students in this process? How efficiently 
can we use micro-content for the courses held for diverse age groups (Generations 
X, Y, Z)? Further research is needed to answer these questions. 

In this paper, essentially micro-content used in an online environment are 
discussed. However, these principles are viable in other forms as well. 


Figure 6: Micro-content in a printed format (posters created by the author) 
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The last figure shows two printed posters where micro-content are arranged 
on a coordinated plane, their location being determined by the information on 
the horizontal and vertical axes. Content in the cells are coherent texts and self- 
explanatory images that can be fully interpreted in themselves; however, they 
can also be processed following a “recommended order” that conveys the exact 
original message of the author. 

This paper wishes to provide an overview about the rapidly developing world 
of micro-content, focusing on practical applications in education. 
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